Jun 24 15:48:23 devstack cinder-volume[82814]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 15:48:23 devstack cinder-volume[82814]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 15:48:23 devstack cinder-volume[82814]: we strongly recommend against using it for new projects. Jun 24 15:48:23 devstack cinder-volume[82814]: If you are already using Eventlet, we recommend migrating to a different Jun 24 15:48:23 devstack cinder-volume[82814]: framework. For more detail see Jun 24 15:48:23 devstack cinder-volume[82814]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 15:48:23 devstack cinder-volume[82814]: import eventlet # noqa Jun 24 15:48:26 devstack cinder-volume[82814]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:48:26 devstack cinder-volume[82814]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:48:26 devstack cinder-volume[82814]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:48:26 devstack cinder-volume[82814]: INFO dbcounter [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Registered counter for database cinder Jun 24 15:48:26 devstack cinder-volume[82814]: DEBUG oslo_db.sqlalchemy.engines [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:48:27 devstack cinder-volume[82814]: DEBUG dbcounter [-] [82814] Writer thread running {{(pid=82814) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 15:48:27 devstack cinder-volume[82814]: INFO cinder.rpc [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 15:48:27 devstack cinder-volume[82814]: INFO cinder.rpc [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 15:48:27 devstack cinder-volume[82814]: DEBUG oslo_db.sqlalchemy.engines [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:48:27 devstack cinder-volume[82814]: INFO cinder.volume.manager [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Determined volume DB was empty at startup. Jun 24 15:48:27 devstack cinder-volume[82814]: DEBUG cinder.volume.manager [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82814) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 15:48:27 devstack cinder-volume[82814]: INFO cinder.volume.manager [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 15:48:27 devstack cinder-volume[82814]: WARNING stevedore.named [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 15:48:27 devstack cinder-volume[82814]: WARNING castellan.key_manager [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:48:27 devstack cinder-volume[82814]: WARNING cinder.keymgr.conf_key_mgr [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:48:27 devstack cinder-volume[82814]: DEBUG cinder.volume.drivers.lvm [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82814) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 24 15:48:27 devstack cinder-volume[82814]: DEBUG oslo_concurrency.processutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82814) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:27 devstack cinder-volume[82814]: DEBUG oslo_concurrency.processutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] CMD "cinder-rtstool verify" returned: 0 in 0.439s {{(pid=82814) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_db.sqlalchemy.engines [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:48:28 devstack cinder-volume[82814]: INFO cinder.rpc [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 24 15:48:28 devstack cinder-volume[82814]: INFO cinder.rpc [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 24 15:48:28 devstack cinder-volume[82814]: WARNING stevedore.named [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 15:48:28 devstack cinder-volume[82814]: WARNING castellan.key_manager [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:48:28 devstack cinder-volume[82814]: INFO cinder.volume.manager [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_db.sqlalchemy.engines [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:48:28 devstack cinder-volume[82814]: INFO oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Starting 1 workers Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Started child 82980 {{(pid=82814) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Full set of CONF: {{(pid=82814) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] ******************************************************************************** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Configuration options gathered from: {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 15:48:28 devstack cinder-volume[82980]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] ================================================================================ {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] allow_availability_zone_fallback = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] allow_compression_on_image_upload = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] allowed_direct_url_schemes = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] api_rate_limit = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] auth_strategy = keystone {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] az_cache_duration = 3600 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_availability_zone = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_host = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_stats_polling_interval = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backup_api_class = cinder.backup.api.API {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backup_name_template = backup-%s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backup_use_same_host = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backup_use_temp_snapshot = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] chap_password = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] chap_username = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_internal_tenant_project_id = 90b5b88906724927b989af863877fee5 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_internal_tenant_user_id = 23a19033dbb6429baa1e356ee322294d {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cloned_volume_same_az = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cluster = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] compression_format = gzip {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] compute_api_class = cinder.compute.nova.API {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] config_dir = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] config_source = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] control_exchange = openstack {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] debug = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] default_availability_zone = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] default_group_type = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] default_volume_type = lvmdriver-1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] disk_geometry = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] driver_client_cert = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] driver_client_cert_key = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] driver_data_namespace = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] driver_ssl_cert_path = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] driver_ssl_cert_verify = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] driver_use_ssl = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] enable_force_upload = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] enable_new_services = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] enable_unsupported_driver = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] enabled_backends = ['lvmdriver-1'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] enforce_multipath_for_image_xfer = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] filter_function = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_api_insecure = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_api_ssl_compression = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_ca_certificates_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_catalog_info = image:glance:publicURL {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_num_retries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance_request_timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] goodness_function = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] graceful_shutdown_timeout = 5 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] group_api_class = cinder.group.api.API {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] host = devstack {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_compress_on_upload = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_conversion_address_space_limit = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_conversion_cpu_limit = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_conversion_disable = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_upload_use_cinder_backend = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_upload_use_internal_tenant = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_volume_cache_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_volume_cache_max_count = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] image_volume_cache_max_size_gb = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] init_host_max_objects_retrieval = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] instance_format = [instance: %(uuid)s] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] iscsi_target_flags = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] iscsi_write_cache = on {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] iser_helper = tgtadm {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] iser_ip_address = 192.168.122.94 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] iser_port = 3260 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_color = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_config_append = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_dir = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_options = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_rotate_interval = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_rotate_interval_type = days {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] log_rotation_type = none {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] max_age = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82980]: INFO cinder.volume.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] max_logfile_count = 30 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] max_logfile_size_mb = 200 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] max_over_subscription_ratio = 20.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] message_reap_interval = 86400 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] message_ttl = 2592000 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] migration_create_volume_timeout_secs = 300 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] monkey_patch = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] monkey_patch_modules = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] my_ip = 192.168.122.94 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] no_snapshot_gb_quota = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] num_iser_scan_tries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] num_shell_tries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] num_volume_device_scan_tries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] nvmeof_conn_info_version = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] nvmet_ns_id = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] nvmet_port_id = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_max_limit = 1000 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_volume_ext_list = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_volume_listen_port = 8776 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_volume_use_ssl = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] osapi_volume_workers = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] per_volume_size_limit = -1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] periodic_fuzzy_delay = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] periodic_interval = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] public_endpoint = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] publish_errors = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_backup_gigabytes = 1000 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_backups = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_gigabytes = 1000 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_groups = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_snapshots = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] quota_volumes = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] rate_limit_burst = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] rate_limit_except_level = CRITICAL {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] rate_limit_interval = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] reinit_driver_count = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] replication_device = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] report_discard_supported = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] report_interval = 120 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] reservation_clean_interval = 86400 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] reservation_expire = 86400 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] reserved_image_namespaces = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] reserved_percentage = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] rpc_response_timeout = 120 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] run_external_periodic_tasks = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] scst_target_driver = iscsi {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] scst_target_iqn_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_down_time = 720 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] shell_completion = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] snapshot_name_template = snapshot-%s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] snapshot_same_host = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] split_loggers = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] state_path = /opt/stack/data/cinder {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] storage_availability_zone = nova {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] storage_protocol = iSCSI {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] syslog_log_facility = LOG_USER {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] target_helper = lioadm {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] target_ip_address = 192.168.122.94 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] target_port = 3260 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] target_protocol = iscsi {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] target_secondary_ip_addresses = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] trace_flags = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] transport_url = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] until_refresh = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_chap_auth = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_default_quota_class = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_journal = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_json = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_multipath_for_image_xfer = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_stderr = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] use_syslog = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] verify_glance_signatures = enabled {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_api_class = cinder.volume.api.API {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_backend_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_clear = zero {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_clear_ionice = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_clear_size = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_copy_bps_limit = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_dd_blocksize = 1M {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_name_template = volume-%s {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_service_inithost_offload = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volume_usage_audit_period = month {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] zoning_mode = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_concurrency.disable_process_locking = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.auth_section = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.auth_type = password {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.auth_version = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.cache = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.include_service_catalog = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.insecure = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.interface = public {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_password = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcache_username = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.region_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.service_token_roles_required = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.service_type = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.backend = dogpile.cache.null {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.backend_argument = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.backend_expiration_time = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.config_prefix = cache.oslo {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.debug_cache_backend = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.enable_retry_client = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.enable_socket_keepalive = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.expiration_time = 600 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.hashclient_retry_attempts = 2 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_dead_retry = 300 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_pool_maxsize = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_sasl_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.password = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.proxies = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.redis_db = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.redis_server = localhost:6379 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.retry_attempts = 2 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.retry_delay = 0.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.socket_keepalive_count = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.socket_keepalive_idle = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.socket_keepalive_interval = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.socket_timeout = 1.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.tls_allowed_ciphers = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.tls_cafile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.tls_certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.tls_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.tls_keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cache.username = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] coordination.backend_url = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.asyncio_connection = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.asyncio_slave_connection = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.backend = sqlalchemy {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.connection = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.connection_debug = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.connection_parameters = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.connection_recycle_time = 3600 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.connection_trace = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.db_inc_retry_interval = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.db_max_retries = 20 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.db_max_retry_interval = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.db_retry_interval = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.max_overflow = 50 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.max_pool_size = 5 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.max_retries = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.mysql_wsrep_sync_wait = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.pool_timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.retry_interval = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.slave_connection = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.sqlite_synchronous = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.synchronous_reader = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] database.use_db_reconnect = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.connection_string = messaging:// {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.es_doc_type = notification {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.es_scroll_size = 10000 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.es_scroll_time = 2m {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.filter_error_trace = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.hmac_keys = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.sentinel_service_name = mymaster {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.socket_timeout = 0.1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.trace_requests = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler.trace_sqlalchemy = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler_jaeger.process_tags = {} {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler_jaeger.service_name_prefix = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] profiler_otlp.service_name_prefix = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.enforce_new_defaults = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: WARNING oslo_config.cfg [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.enforce_scope = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.policy_default_rule = default {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.policy_file = policy.yaml {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.group = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.helper_command = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] privsep_osbrick.user = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.group = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.helper_command = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] cinder_sys_admin.user = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.auth_section = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.auth_type = password {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.cafile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.collect_timing = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.insecure = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.send_service_user_token = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.split_loggers = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] service_user.timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.auth_section = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.auth_type = password {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.collect_timing = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.insecure = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.region_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.split_loggers = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] glance.timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.backend_availability_zone = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.chap_password = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.chap_username = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.disk_geometry = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.driver_client_cert = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.driver_client_cert_key = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.driver_data_namespace = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.driver_use_ssl = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.extra_capabilities = {} {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.filter_function = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.goodness_function = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.iscsi_target_flags = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.iscsi_write_cache = on {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.iser_helper = tgtadm {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.iser_port = 3260 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.lvm_mirrors = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.lvm_share_target = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.lvm_type = auto {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.num_shell_tries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.replication_device = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.report_discard_supported = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.reserved_percentage = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.target_helper = tgtadm {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.target_port = 3260 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.target_protocol = iscsi {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.trace_flags = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.unique_fqdn_network = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.use_chap_auth = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_backend_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_clear = zero {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_clear_ionice = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_clear_size = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volume_group = cinder-volumes {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_reports.file_event_handler = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_reports.log_dir = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.backend_availability_zone = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.backend_host = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.chap_password = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.chap_username = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.chiscsi_conf = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.disk_geometry = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.driver_client_cert = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.driver_data_namespace = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.driver_use_ssl = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.extra_capabilities = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.filter_function = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.goodness_function = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.iser_helper = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.iser_ip_address = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.iser_port = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.iser_target_prefix = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.lvm_conf_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.lvm_mirrors = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.lvm_share_target = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.lvm_type = auto {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.num_shell_tries = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.nvmet_port_id = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.replication_device = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.report_discard_supported = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.reserved_percentage = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.scst_target_driver = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.storage_protocol = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.target_helper = lioadm {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.target_ip_address = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.target_port = 3260 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.target_protocol = iscsi {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.trace_flags = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.use_chap_auth = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_clear = zero {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_clear_size = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] lvmdriver-1.volumes_dir = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack sudo[82984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack sudo[82984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_notifications.driver = [] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_notifications.retry = -1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] key_manager.fixed_key = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.barbican_api_version = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.barbican_endpoint = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.barbican_endpoint_type = public {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.barbican_region_name = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.cafile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.collect_timing = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.insecure = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.number_of_retries = 60 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.retry_delay = 1 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.send_service_user_token = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.split_loggers = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.verify_ssl = True {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican.verify_ssl_path = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.auth_section = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.auth_type = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.cafile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.certfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.collect_timing = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.insecure = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.keyfile = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.split_loggers = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] barbican_service_user.timeout = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.approle_role_id = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.approle_secret_id = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.kv_mountpoint = secret {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.kv_path = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.kv_version = 2 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.namespace = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.root_token_id = **** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.ssl_ca_crt_file = None {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.timeout = 60.0 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.use_ssl = False {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:48:28 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] ******************************************************************************** {{(pid=82814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 15:48:29 devstack sudo[82984]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:29 devstack sudo[83075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:29 devstack sudo[83075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:29 devstack sudo[83075]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.643s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 15:48:29 devstack cinder-volume[82980]: INFO cinder.brick.local_dev.lvm [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:29 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:29 devstack sudo[83290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:48:29 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:30 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:30 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:30 devstack cinder-volume[82980]: DEBUG cinder.brick.local_dev.lvm [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82980) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 24 15:48:30 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:30 devstack sudo[83477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:30 devstack sudo[83477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:31 devstack sudo[83477]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:31 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.500s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:31 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:31 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:31 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:31 devstack sudo[83742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:31 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:32 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:32 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:32 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:32 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:32 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:32 devstack sudo[83767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 24 15:48:32 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:33 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:33 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.780s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:33 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:33 devstack sudo[83770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:48:33 devstack sudo[83770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:34 devstack sudo[83770]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:34 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:34 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:34 devstack sudo[83780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:48:34 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:34 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:34 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.839s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:34 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:34 devstack sudo[83786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:35 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:35 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:35 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:35 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:35 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:35 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:36 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:36 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:36 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:36 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:36 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:36 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:36 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:37 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.710s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:37 devstack cinder-volume[82980]: INFO cinder.volume.drivers.lvm [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:37 devstack sudo[83810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:37 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:37 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.744s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:48:37 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:37 devstack sudo[83927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:48:37 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:38 devstack cinder-volume[82814]: DEBUG dbcounter [-] [82814] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82814) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:48:38 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:38 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:38 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:38 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:38 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:39 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:39 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:39 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:39 devstack sudo[84071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:39 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:39 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:39 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:39 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:39 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:39 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:40 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:40 devstack cinder-volume[82980]: INFO cinder.volume.driver [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG cinder.volume.driver [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82980) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG oslo_db.sqlalchemy.engines [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG dbcounter [-] [82980] Writer thread running {{(pid=82980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG cinder.db.api [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Building query based on filter {{(pid=82980) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG cinder.image.image_utils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82980) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 15:48:40 devstack cinder-volume[82980]: INFO cinder.keymgr.migration [None req-13bb93da-4d45-4493-9164-37646cc6f1e6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:48:40 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:40 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:48:40 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:41 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:41 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:41 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:41 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:41 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:41 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:41 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:41 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:42 devstack sudo[84124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:42 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:42 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:42 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:42 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:42 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:42 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:43 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:43 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:43 devstack cinder-volume[82980]: DEBUG cinder.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Notifying Schedulers of capabilities ... {{(pid=82980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:48:43 devstack cinder-volume[82980]: INFO cinder.volume.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Driver initialization completed successfully. Jun 24 15:48:43 devstack cinder-volume[82980]: INFO cinder.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Initiating service 2 cleanup Jun 24 15:48:43 devstack cinder-volume[82980]: INFO cinder.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Service 2 cleanup completed. Jun 24 15:48:43 devstack cinder-volume[82980]: DEBUG cinder.service [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Creating RPC server for service cinder-volume {{(pid=82980) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 15:48:43 devstack cinder-volume[82980]: DEBUG cinder.service [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82980) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 15:48:43 devstack cinder-volume[82980]: INFO cinder.volume.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 24 15:48:43 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:48:43 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:43 devstack sudo[84132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:48:43 devstack sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:44 devstack sudo[84132]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:44 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:44 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:44 devstack sudo[84136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:44 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:44 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:44 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:44 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:44 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:48:44 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:45 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:45 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:45 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:48:45 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:48:45 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:48:45 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Jun 24 15:48:45 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:48:45 devstack cinder-volume[82980]: INFO cinder.volume.manager [None req-b68bb5a7-fa4a-43a5-92e8-4eb8a82d0a58 None None] Driver post RPC initialization completed successfully. Jun 24 15:48:55 devstack cinder-volume[82980]: DEBUG dbcounter [-] [82980] Writing DB stats cinder:SELECT=3 {{(pid=82980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:48:56 devstack cinder-volume[82980]: DEBUG dbcounter [-] [82980] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:49:25 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager._thread_info {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:49:25 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread count: 6 {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:49:25 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread info: [<_MainThread(MainThread, started 140366837600384)>, , , , , ] {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:50:25 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:50:25 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:50:25 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:50:26 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:50:26 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:50:26 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Jun 24 15:50:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:50:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:50:26 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:50:26 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:50:27 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jun 24 15:50:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:50:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:50:27 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:50:27 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:50:27 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Jun 24 15:50:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.604s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:50:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:50:27 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:50:27 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:50:28 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Jun 24 15:50:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:50:28 devstack cinder-volume[82980]: DEBUG cinder.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Notifying Schedulers of capabilities ... {{(pid=82980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:50:28 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager._thread_info {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:50:28 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread count: 6 {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:50:28 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread info: [<_MainThread(MainThread, started 140366837600384)>, , , , , ] {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:50:56 devstack cinder-volume[82980]: DEBUG dbcounter [-] [82980] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:51:25 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:51:25 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:51:25 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:51:26 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:51:26 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:51:26 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Jun 24 15:51:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:51:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:51:26 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:51:26 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:51:27 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Jun 24 15:51:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:51:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:51:27 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:51:27 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:51:27 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Jun 24 15:51:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:51:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:51:27 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:51:27 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:51:28 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Jun 24 15:51:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:51:28 devstack cinder-volume[82980]: DEBUG cinder.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Notifying Schedulers of capabilities ... {{(pid=82980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:51:28 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager._thread_info {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:51:28 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread count: 6 {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:51:28 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread info: [<_MainThread(MainThread, started 140366837600384)>, , , , , ] {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:52:26 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:52:26 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:52:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:52:26 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:52:26 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:52:26 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jun 24 15:52:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:52:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:52:26 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:52:26 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:52:27 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Jun 24 15:52:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:52:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:52:27 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:52:27 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:52:27 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jun 24 15:52:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:52:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:52:27 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:52:27 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:52:28 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Jun 24 15:52:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:52:28 devstack cinder-volume[82980]: DEBUG cinder.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Notifying Schedulers of capabilities ... {{(pid=82980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:52:56 devstack cinder-volume[82980]: DEBUG dbcounter [-] [82980] Writing DB stats cinder:SELECT=1 {{(pid=82980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:52:56 devstack cinder-volume[82980]: DEBUG dbcounter [-] [82980] Writing DB stats cinder:UPDATE=1 {{(pid=82980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:53:26 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:53:26 devstack cinder-volume[82980]: DEBUG cinder.volume.drivers.lvm [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Updating volume stats {{(pid=82980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 15:53:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:26 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 15:53:26 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:26 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:26 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:26 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:53:26 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:27 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:27 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 15:53:27 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:27 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:27 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:27 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 15:53:27 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:28 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:28 devstack cinder-volume[82980]: DEBUG oslo_concurrency.processutils [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:28 devstack cinder-volume[82980]: DEBUG cinder.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Notifying Schedulers of capabilities ... {{(pid=82980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:53:28 devstack cinder-volume[82980]: DEBUG oslo_service.periodic_task [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] Running periodic task VolumeManager._thread_info {{(pid=82980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:53:28 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread count: 6 {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:53:28 devstack cinder-volume[82980]: DEBUG cinder.volume.manager [None req-3d36ea11-97cb-4ce9-bebe-3e286ad1c6cb None None] thread info: [<_MainThread(MainThread, started 140366837600384)>, , , , , ] {{(pid=82980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:53:29 devstack cinder-volume[82814]: INFO oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Caught SIGTERM, stopping children Jun 24 15:53:29 devstack cinder-volume[82814]: DEBUG oslo_concurrency.lockutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Acquiring lock "singleton_lock" {{(pid=82814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:53:29 devstack cinder-volume[82814]: DEBUG oslo_concurrency.lockutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Acquired lock "singleton_lock" {{(pid=82814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:53:29 devstack cinder-volume[82814]: DEBUG oslo_concurrency.lockutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Releasing lock "singleton_lock" {{(pid=82814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:53:29 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Stop services. {{(pid=82814) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 15:53:29 devstack cinder-volume[82814]: DEBUG oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Killing children. {{(pid=82814) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 15:53:29 devstack cinder-volume[82814]: INFO oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Waiting on 1 children to exit Jun 24 15:53:33 devstack cinder-volume[82980]: DEBUG oslo_concurrency.lockutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Acquiring lock "singleton_lock" {{(pid=82980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:53:33 devstack cinder-volume[82980]: DEBUG oslo_concurrency.lockutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Acquired lock "singleton_lock" {{(pid=82980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:53:33 devstack cinder-volume[82980]: DEBUG oslo_concurrency.lockutils [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Releasing lock "singleton_lock" {{(pid=82980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:53:33 devstack cinder-volume[82980]: WARNING amqp [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 15:53:33 devstack cinder-volume[82980]: WARNING amqp [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 15:53:33 devstack cinder-volume[82814]: INFO oslo_service.backend._eventlet.service [None req-f53f188e-4405-4577-bdbb-d696bc9f344a None None] Child 82980 exited with status 0 Jun 24 15:53:33 devstack cinder-volume[93075]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 15:53:33 devstack cinder-volume[93075]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 15:53:33 devstack cinder-volume[93075]: we strongly recommend against using it for new projects. Jun 24 15:53:33 devstack cinder-volume[93075]: If you are already using Eventlet, we recommend migrating to a different Jun 24 15:53:33 devstack cinder-volume[93075]: framework. For more detail see Jun 24 15:53:33 devstack cinder-volume[93075]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 15:53:33 devstack cinder-volume[93075]: import eventlet # noqa Jun 24 15:53:35 devstack cinder-volume[93075]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:53:35 devstack cinder-volume[93075]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:53:35 devstack cinder-volume[93075]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:53:36 devstack cinder-volume[93075]: INFO dbcounter [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Registered counter for database cinder Jun 24 15:53:36 devstack cinder-volume[93075]: DEBUG oslo_db.sqlalchemy.engines [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:36 devstack cinder-volume[93075]: DEBUG dbcounter [-] [93075] Writer thread running {{(pid=93075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 15:53:36 devstack cinder-volume[93075]: INFO cinder.rpc [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 15:53:36 devstack cinder-volume[93075]: INFO cinder.rpc [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_db.sqlalchemy.engines [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:37 devstack cinder-volume[93075]: INFO cinder.volume.manager [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Determined volume DB was empty at startup. Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG cinder.volume.manager [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93075) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 15:53:37 devstack cinder-volume[93075]: INFO cinder.volume.manager [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 15:53:37 devstack cinder-volume[93075]: WARNING stevedore.named [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 15:53:37 devstack cinder-volume[93075]: WARNING castellan.key_manager [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:53:37 devstack cinder-volume[93075]: WARNING cinder.keymgr.conf_key_mgr [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:53:37 devstack cinder-volume[93075]: INFO cinder.volume.manager [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_db.sqlalchemy.engines [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:37 devstack cinder-volume[93075]: INFO oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Starting 1 workers Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Started child 93292 {{(pid=93075) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Full set of CONF: {{(pid=93075) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] ******************************************************************************** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Configuration options gathered from: {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] ================================================================================ {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] allow_availability_zone_fallback = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93292]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] allow_compression_on_image_upload = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] allowed_direct_url_schemes = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] api_rate_limit = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] auth_strategy = keystone {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_availability_zone = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_host = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_stats_polling_interval = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backup_api_class = cinder.backup.api.API {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backup_name_template = backup-%s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backup_use_same_host = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backup_use_temp_snapshot = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] chap_password = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] chap_username = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_internal_tenant_project_id = 90b5b88906724927b989af863877fee5 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_internal_tenant_user_id = 23a19033dbb6429baa1e356ee322294d {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cluster = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] compression_format = gzip {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] compute_api_class = cinder.compute.nova.API {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] config_dir = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] config_source = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] control_exchange = openstack {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] debug = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] default_availability_zone = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] default_group_type = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] default_volume_type = QuobyteHD {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] disk_geometry = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] driver_client_cert = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] driver_client_cert_key = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] driver_data_namespace = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] driver_ssl_cert_path = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] driver_ssl_cert_verify = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] driver_use_ssl = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] enable_new_services = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] enable_unsupported_driver = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] enabled_backends = ['QuobyteHD'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] enforce_multipath_for_image_xfer = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] filter_function = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_api_insecure = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_api_ssl_compression = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_ca_certificates_file = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_catalog_info = image:glance:publicURL {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_num_retries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance_request_timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] goodness_function = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] graceful_shutdown_timeout = 5 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] group_api_class = cinder.group.api.API {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] host = devstack {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_compress_on_upload = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_conversion_address_space_limit = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_conversion_cpu_limit = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_conversion_disable = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_upload_use_cinder_backend = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_upload_use_internal_tenant = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_volume_cache_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_volume_cache_max_count = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] image_volume_cache_max_size_gb = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] init_host_max_objects_retrieval = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] instance_format = [instance: %(uuid)s] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] iscsi_target_flags = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] iscsi_write_cache = on {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] iser_helper = tgtadm {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] iser_ip_address = 192.168.122.94 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] iser_port = 3260 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_color = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_config_append = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_dir = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_file = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_options = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_rotate_interval = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_rotate_interval_type = days {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] log_rotation_type = none {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] max_age = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] max_logfile_count = 30 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] max_logfile_size_mb = 200 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] max_over_subscription_ratio = 20.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] message_reap_interval = 86400 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] message_ttl = 2592000 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] migration_create_volume_timeout_secs = 300 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] monkey_patch = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] monkey_patch_modules = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] my_ip = 192.168.122.94 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] no_snapshot_gb_quota = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] num_iser_scan_tries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] num_shell_tries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93292]: INFO cinder.volume.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.remotefs [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93292) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] num_volume_device_scan_tries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] nvmeof_conn_info_version = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] nvmet_ns_id = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] nvmet_port_id = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_max_limit = 1000 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_volume_ext_list = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_volume_listen_port = 8776 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_volume_use_ssl = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] osapi_volume_workers = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] per_volume_size_limit = -1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] periodic_fuzzy_delay = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] periodic_interval = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] public_endpoint = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] publish_errors = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_backup_gigabytes = 1000 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_backups = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_gigabytes = 1000 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_groups = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_snapshots = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] quota_volumes = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] rate_limit_burst = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] rate_limit_except_level = CRITICAL {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] rate_limit_interval = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] reinit_driver_count = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] replication_device = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] report_discard_supported = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] report_interval = 120 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] reservation_clean_interval = 86400 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] reservation_expire = 86400 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] reserved_image_namespaces = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] reserved_percentage = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] rpc_response_timeout = 120 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] run_external_periodic_tasks = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] scst_target_driver = iscsi {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] scst_target_iqn_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_down_time = 720 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] shell_completion = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] snapshot_name_template = snapshot-%s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] split_loggers = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] state_path = /opt/stack/data/cinder {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] storage_availability_zone = nova {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] storage_protocol = iSCSI {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] syslog_log_facility = LOG_USER {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] target_helper = lioadm {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] target_ip_address = 192.168.122.94 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] target_port = 3260 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] target_protocol = iscsi {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] target_secondary_ip_addresses = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] trace_flags = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] transport_url = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] until_refresh = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_chap_auth = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_default_quota_class = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_journal = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_json = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_multipath_for_image_xfer = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_stderr = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] use_syslog = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] verify_glance_signatures = enabled {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_api_class = cinder.volume.api.API {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_backend_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_clear = zero {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_clear_ionice = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_clear_size = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_copy_bps_limit = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_dd_blocksize = 1M {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_name_template = volume-%s {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_service_inithost_offload = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volume_usage_audit_period = month {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] zoning_mode = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_concurrency.disable_process_locking = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.auth_section = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.auth_type = password {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.auth_version = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.cache = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.include_service_catalog = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.insecure = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.interface = public {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_password = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcache_username = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.region_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.service_type = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.backend = dogpile.cache.null {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.backend_argument = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.backend_expiration_time = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.config_prefix = cache.oslo {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.debug_cache_backend = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.enable_retry_client = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.enable_socket_keepalive = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.expiration_time = 600 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.hashclient_retry_attempts = 2 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_dead_retry = 300 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_pool_maxsize = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_sasl_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.password = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.proxies = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.redis_db = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.redis_server = localhost:6379 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.retry_attempts = 2 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.retry_delay = 0.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.socket_keepalive_count = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.socket_keepalive_idle = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.socket_keepalive_interval = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.socket_timeout = 1.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.tls_allowed_ciphers = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.tls_cafile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.tls_certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.tls_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93292) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 15:53:37 devstack cinder-volume[93292]: WARNING cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 15:53:37 devstack cinder-volume[93292]: WARNING cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Running cmd (subprocess): mount.quobyte {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.tls_keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cache.username = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] coordination.backend_url = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.asyncio_connection = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.asyncio_slave_connection = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.backend = sqlalchemy {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.connection = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.connection_debug = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.connection_parameters = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.connection_recycle_time = 3600 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.connection_trace = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.db_inc_retry_interval = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.db_max_retries = 20 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.db_max_retry_interval = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.db_retry_interval = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.max_overflow = 50 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.max_pool_size = 5 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.max_retries = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.mysql_wsrep_sync_wait = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.pool_timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.retry_interval = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.slave_connection = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.sqlite_synchronous = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.synchronous_reader = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] database.use_db_reconnect = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.connection_string = messaging:// {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.es_doc_type = notification {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.es_scroll_size = 10000 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.es_scroll_time = 2m {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.filter_error_trace = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.hmac_keys = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.sentinel_service_name = mymaster {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.socket_timeout = 0.1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.trace_requests = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler.trace_sqlalchemy = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler_jaeger.process_tags = {} {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler_jaeger.service_name_prefix = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] profiler_otlp.service_name_prefix = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.enforce_new_defaults = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: WARNING oslo_config.cfg [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.enforce_scope = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.policy_default_rule = default {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.policy_file = policy.yaml {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.group = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.helper_command = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] privsep_osbrick.user = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.group = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.helper_command = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] cinder_sys_admin.user = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.auth_section = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.auth_type = password {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.cafile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.collect_timing = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.insecure = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.send_service_user_token = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.split_loggers = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] service_user.timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.auth_section = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.auth_type = password {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.collect_timing = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.insecure = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.region_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.split_loggers = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] glance.timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.backend_availability_zone = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.chap_password = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.chap_username = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.disk_geometry = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.driver_client_cert = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.driver_client_cert_key = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.driver_data_namespace = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.driver_use_ssl = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.extra_capabilities = {} {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.filter_function = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.goodness_function = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.iscsi_target_flags = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.iscsi_write_cache = on {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.iser_helper = tgtadm {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.iser_port = 3260 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_host = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_login = admin {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_mount_options = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_password = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_private_key = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_share_path = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.num_shell_tries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.quobyte_volume_url = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.replication_device = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.report_discard_supported = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.reserved_percentage = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.target_helper = tgtadm {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.target_port = 3260 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.target_protocol = iscsi {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.trace_flags = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.unique_fqdn_network = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.use_chap_auth = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_backend_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_clear = zero {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_clear_ionice = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_clear_size = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_reports.file_event_handler = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_reports.log_dir = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.backend_availability_zone = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.backend_host = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.chap_password = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.chap_username = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.chiscsi_conf = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.disk_geometry = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.driver_client_cert = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.driver_data_namespace = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.driver_use_ssl = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.extra_capabilities = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.filter_function = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.goodness_function = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.iser_helper = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.iser_ip_address = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.iser_port = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.iser_target_prefix = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_host = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_login = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_mount_options = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_password = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_private_key = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_share_path = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_ssh_port = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.num_shell_tries = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.nvmet_port_id = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.replication_device = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.report_discard_supported = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack quobyte-client[93295]: Reading configuration file: /etc/quobyte/client.cfg Jun 24 15:53:37 devstack quobyte-client[93295]: Invalid parameters found, error: missing mount point. Jun 24 15:53:37 devstack quobyte-client[93295]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.reserved_percentage = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.scst_target_driver = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.storage_protocol = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.target_helper = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack quobyte-client[93295]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.target_ip_address = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.target_port = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.target_prefix = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.target_protocol = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.trace_flags = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93292]: INFO cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 ... Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.use_chap_auth = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d -c /etc/quobyte/client-cinder.cfg {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_clear = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_clear_size = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] QuobyteHD.volumes_dir = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d -c /etc/quobyte/client-cinder.cfg Jun 24 15:53:37 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_notifications.driver = [] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_notifications.retry = -1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] key_manager.fixed_key = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.barbican_api_version = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.barbican_endpoint = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.barbican_endpoint_type = public {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.barbican_region_name = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.cafile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.collect_timing = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.insecure = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.number_of_retries = 60 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.retry_delay = 1 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.send_service_user_token = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.split_loggers = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.verify_ssl = True {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican.verify_ssl_path = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.auth_section = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.auth_type = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.cafile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.certfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.collect_timing = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.insecure = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.keyfile = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.split_loggers = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] barbican_service_user.timeout = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.approle_role_id = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.approle_secret_id = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.kv_mountpoint = secret {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.kv_path = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.kv_version = 2 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.namespace = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.root_token_id = **** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.ssl_ca_crt_file = None {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.timeout = 60.0 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.use_ssl = False {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:37 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] ******************************************************************************** {{(pid=93075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 15:53:38 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:38 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.788s {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:38 devstack cinder-volume[93292]: INFO cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 succeeded Jun 24 15:53:38 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:38 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.800s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:38 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:38 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:38 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:39 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.604s {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:39 devstack cinder-volume[93292]: INFO cinder.volume.driver [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.volume.driver [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93292) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_db.sqlalchemy.engines [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG dbcounter [-] [93292] Writer thread running {{(pid=93292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.db.api [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Building query based on filter {{(pid=93292) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.image.image_utils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93292) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 15:53:39 devstack cinder-volume[93292]: INFO cinder.keymgr.migration [None req-1b3a6271-0adb-41bb-9dbd-231dd56c5718 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:39 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:39 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:39 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.606s {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Notifying Schedulers of capabilities ... {{(pid=93292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:53:39 devstack cinder-volume[93292]: INFO cinder.volume.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Driver initialization completed successfully. Jun 24 15:53:39 devstack cinder-volume[93292]: INFO cinder.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Initiating service 3 cleanup Jun 24 15:53:39 devstack cinder-volume[93292]: INFO cinder.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Service 3 cleanup completed. Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.service [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Creating RPC server for service cinder-volume {{(pid=93292) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.service [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93292) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 15:53:39 devstack cinder-volume[93292]: INFO cinder.volume.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:39 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:40 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:40 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:40 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:40 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.634s {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:40 devstack cinder-volume[93292]: INFO cinder.volume.manager [None req-24ec1339-879f-457b-be71-fbafc85041d6 None None] Driver post RPC initialization completed successfully. Jun 24 15:53:44 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:44 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:44 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93292) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:44 devstack cinder-volume[93292]: DEBUG cinder.volume.drivers.quobyte [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93292) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:44 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93292) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:44 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:44 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:44 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:45 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:45 devstack cinder-volume[93292]: DEBUG oslo_concurrency.processutils [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.587s {{(pid=93292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:45 devstack cinder-volume[93292]: DEBUG cinder.manager [None req-69d6c236-f959-4e86-9767-967e3de87c07 None None] Notifying Schedulers of capabilities ... {{(pid=93292) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:53:46 devstack cinder-volume[93075]: INFO oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Caught SIGTERM, stopping children Jun 24 15:53:46 devstack cinder-volume[93075]: DEBUG oslo_concurrency.lockutils [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Acquiring lock "singleton_lock" {{(pid=93075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:53:46 devstack cinder-volume[93075]: DEBUG oslo_concurrency.lockutils [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Acquired lock "singleton_lock" {{(pid=93075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:53:46 devstack cinder-volume[93075]: DEBUG oslo_concurrency.lockutils [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Releasing lock "singleton_lock" {{(pid=93075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:53:46 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Stop services. {{(pid=93075) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 15:53:46 devstack cinder-volume[93075]: DEBUG oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Killing children. {{(pid=93075) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 15:53:46 devstack cinder-volume[93075]: INFO oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Waiting on 1 children to exit Jun 24 15:53:48 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Acquiring lock "singleton_lock" {{(pid=93292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:53:48 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Acquired lock "singleton_lock" {{(pid=93292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:53:48 devstack cinder-volume[93292]: DEBUG oslo_concurrency.lockutils [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Releasing lock "singleton_lock" {{(pid=93292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:53:48 devstack cinder-volume[93292]: WARNING amqp [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 15:53:48 devstack cinder-volume[93292]: WARNING amqp [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 15:53:48 devstack cinder-volume[93075]: INFO oslo_service.backend._eventlet.service [None req-26fee226-0127-44cd-9782-775c2a00ea22 None None] Child 93292 exited with status 0 Jun 24 15:53:48 devstack cinder-volume[93610]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 15:53:48 devstack cinder-volume[93610]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 15:53:48 devstack cinder-volume[93610]: we strongly recommend against using it for new projects. Jun 24 15:53:48 devstack cinder-volume[93610]: If you are already using Eventlet, we recommend migrating to a different Jun 24 15:53:48 devstack cinder-volume[93610]: framework. For more detail see Jun 24 15:53:48 devstack cinder-volume[93610]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 15:53:48 devstack cinder-volume[93610]: import eventlet # noqa Jun 24 15:53:51 devstack cinder-volume[93610]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 15:53:51 devstack cinder-volume[93610]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 15:53:51 devstack cinder-volume[93610]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 15:53:52 devstack cinder-volume[93610]: INFO dbcounter [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Registered counter for database cinder Jun 24 15:53:52 devstack cinder-volume[93610]: DEBUG oslo_db.sqlalchemy.engines [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:52 devstack cinder-volume[93610]: DEBUG dbcounter [-] [93610] Writer thread running {{(pid=93610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 15:53:52 devstack cinder-volume[93610]: INFO cinder.rpc [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 15:53:52 devstack cinder-volume[93610]: INFO cinder.rpc [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_db.sqlalchemy.engines [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:53 devstack cinder-volume[93610]: INFO cinder.volume.manager [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Determined volume DB was empty at startup. Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG cinder.volume.manager [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93610) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 15:53:53 devstack cinder-volume[93610]: WARNING stevedore.named [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 15:53:53 devstack cinder-volume[93610]: WARNING castellan.key_manager [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:53:53 devstack cinder-volume[93610]: WARNING cinder.keymgr.conf_key_mgr [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 15:53:53 devstack cinder-volume[93610]: INFO cinder.volume.manager [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_db.sqlalchemy.engines [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:53 devstack cinder-volume[93610]: INFO oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Starting 1 workers Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Started child 93867 {{(pid=93610) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Full set of CONF: {{(pid=93610) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] ******************************************************************************** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Configuration options gathered from: {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 15:53:53 devstack cinder-volume[93867]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] ================================================================================ {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] allow_availability_zone_fallback = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] allow_compression_on_image_upload = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] allowed_direct_url_schemes = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] api_rate_limit = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] auth_strategy = keystone {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_availability_zone = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_host = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_stats_polling_interval = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backup_api_class = cinder.backup.api.API {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backup_name_template = backup-%s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backup_use_same_host = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backup_use_temp_snapshot = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] chap_password = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] chap_username = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_internal_tenant_project_id = 90b5b88906724927b989af863877fee5 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_internal_tenant_user_id = 23a19033dbb6429baa1e356ee322294d {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cluster = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] compression_format = gzip {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] compute_api_class = cinder.compute.nova.API {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] config_dir = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] config_source = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] control_exchange = openstack {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] debug = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] default_availability_zone = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] default_group_type = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] default_volume_type = QuobyteHD {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] disk_geometry = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] driver_client_cert = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] driver_client_cert_key = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] driver_data_namespace = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] driver_ssl_cert_path = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] driver_ssl_cert_verify = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] driver_use_ssl = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] enable_new_services = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] enable_unsupported_driver = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] enabled_backends = ['QuobyteHD'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] enforce_multipath_for_image_xfer = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] filter_function = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_api_insecure = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_api_ssl_compression = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_ca_certificates_file = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_catalog_info = image:glance:publicURL {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_num_retries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance_request_timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] goodness_function = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] graceful_shutdown_timeout = 5 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] group_api_class = cinder.group.api.API {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] host = devstack {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_compress_on_upload = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_conversion_address_space_limit = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_conversion_cpu_limit = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_conversion_disable = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_upload_use_cinder_backend = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_upload_use_internal_tenant = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_volume_cache_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_volume_cache_max_count = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] image_volume_cache_max_size_gb = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] init_host_max_objects_retrieval = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] instance_format = [instance: %(uuid)s] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] iscsi_target_flags = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] iscsi_write_cache = on {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] iser_helper = tgtadm {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] iser_ip_address = 192.168.122.94 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] iser_port = 3260 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_color = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_config_append = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_dir = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_file = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_options = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93867) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_rotate_interval = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_rotate_interval_type = days {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] log_rotation_type = none {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] max_age = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] max_logfile_count = 30 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] max_logfile_size_mb = 200 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] max_over_subscription_ratio = 20.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] message_reap_interval = 86400 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] message_ttl = 2592000 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] migration_create_volume_timeout_secs = 300 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] monkey_patch = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] monkey_patch_modules = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] my_ip = 192.168.122.94 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] no_snapshot_gb_quota = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] num_iser_scan_tries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] num_shell_tries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] num_volume_device_scan_tries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] nvmeof_conn_info_version = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] nvmet_ns_id = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] nvmet_port_id = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_max_limit = 1000 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_volume_ext_list = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_volume_listen_port = 8776 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_volume_use_ssl = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] osapi_volume_workers = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] per_volume_size_limit = -1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] periodic_fuzzy_delay = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] periodic_interval = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] public_endpoint = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] publish_errors = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_backup_gigabytes = 1000 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_backups = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_gigabytes = 1000 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_groups = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_snapshots = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] quota_volumes = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] rate_limit_burst = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] rate_limit_except_level = CRITICAL {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] rate_limit_interval = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] reinit_driver_count = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] replication_device = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] report_discard_supported = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] report_interval = 120 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] reservation_clean_interval = 86400 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] reservation_expire = 86400 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] reserved_image_namespaces = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] reserved_percentage = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] rpc_response_timeout = 120 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] run_external_periodic_tasks = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] scst_target_driver = iscsi {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] scst_target_iqn_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_down_time = 720 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] shell_completion = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] snapshot_name_template = snapshot-%s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] split_loggers = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] state_path = /opt/stack/data/cinder {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] storage_availability_zone = nova {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] storage_protocol = iSCSI {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] syslog_log_facility = LOG_USER {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] target_helper = lioadm {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] target_ip_address = 192.168.122.94 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] target_port = 3260 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] target_protocol = iscsi {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] target_secondary_ip_addresses = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] trace_flags = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] transport_url = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] until_refresh = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_chap_auth = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_default_quota_class = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_journal = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_json = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_multipath_for_image_xfer = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_stderr = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] use_syslog = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] verify_glance_signatures = enabled {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_api_class = cinder.volume.api.API {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_backend_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_clear = zero {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_clear_ionice = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_clear_size = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_copy_bps_limit = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_dd_blocksize = 1M {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_name_template = volume-%s {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_service_inithost_offload = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volume_usage_audit_period = month {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] zoning_mode = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_concurrency.disable_process_locking = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.auth_section = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.auth_type = password {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.auth_version = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.cache = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.include_service_catalog = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.insecure = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.interface = public {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_password = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcache_username = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.region_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.service_type = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.backend = dogpile.cache.null {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.backend_argument = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.backend_expiration_time = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.config_prefix = cache.oslo {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.debug_cache_backend = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.enable_retry_client = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.enable_socket_keepalive = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.expiration_time = 600 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.hashclient_retry_attempts = 2 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_dead_retry = 300 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_pool_maxsize = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_sasl_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93867) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 15:53:53 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 15:53:53 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Running cmd (subprocess): mount.quobyte {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.password = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.proxies = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.redis_db = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.redis_server = localhost:6379 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.retry_attempts = 2 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.retry_delay = 0.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.socket_keepalive_count = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.socket_keepalive_idle = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.socket_keepalive_interval = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.socket_timeout = 1.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.tls_allowed_ciphers = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.tls_cafile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.tls_certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.tls_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.tls_keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cache.username = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] coordination.backend_url = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.asyncio_connection = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.asyncio_slave_connection = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.backend = sqlalchemy {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.connection = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.connection_debug = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.connection_parameters = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.connection_recycle_time = 3600 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.connection_trace = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.db_inc_retry_interval = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.db_max_retries = 20 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.db_max_retry_interval = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.db_retry_interval = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.max_overflow = 50 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.max_pool_size = 5 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.max_retries = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.mysql_wsrep_sync_wait = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.pool_timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.retry_interval = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.slave_connection = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.sqlite_synchronous = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.synchronous_reader = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] database.use_db_reconnect = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.connection_string = messaging:// {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.es_doc_type = notification {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.es_scroll_size = 10000 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.es_scroll_time = 2m {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.filter_error_trace = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.hmac_keys = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.sentinel_service_name = mymaster {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.socket_timeout = 0.1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.trace_requests = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler.trace_sqlalchemy = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler_jaeger.process_tags = {} {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler_jaeger.service_name_prefix = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] profiler_otlp.service_name_prefix = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.enforce_new_defaults = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: WARNING oslo_config.cfg [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.enforce_scope = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.policy_default_rule = default {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.policy_file = policy.yaml {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.group = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.helper_command = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] privsep_osbrick.user = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.group = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.helper_command = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] cinder_sys_admin.user = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.auth_section = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.auth_type = password {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.cafile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.collect_timing = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.insecure = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.send_service_user_token = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.split_loggers = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] service_user.timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.auth_section = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.auth_type = password {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.collect_timing = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.insecure = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.region_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.split_loggers = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] glance.timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.backend_availability_zone = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.chap_password = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.chap_username = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.disk_geometry = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.driver_client_cert = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.driver_client_cert_key = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.driver_data_namespace = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.driver_use_ssl = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.extra_capabilities = {} {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.filter_function = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.goodness_function = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.iscsi_target_flags = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.iscsi_write_cache = on {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.iser_helper = tgtadm {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.iser_port = 3260 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_host = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_login = admin {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_mount_options = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_password = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_private_key = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_share_path = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.num_shell_tries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.quobyte_volume_url = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.replication_device = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.report_discard_supported = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.reserved_percentage = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.target_helper = tgtadm {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.target_port = 3260 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.target_protocol = iscsi {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.trace_flags = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.unique_fqdn_network = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.use_chap_auth = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_backend_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_clear = zero {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_clear_ionice = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_clear_size = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_reports.file_event_handler = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_reports.log_dir = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.backend_availability_zone = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.backend_host = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.chap_password = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.chap_username = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.chiscsi_conf = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.disk_geometry = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.driver_client_cert = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.driver_data_namespace = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.driver_use_ssl = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.extra_capabilities = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.filter_function = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.goodness_function = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.iser_helper = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.iser_ip_address = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.iser_port = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.iser_target_prefix = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_host = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_login = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_mount_options = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_password = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_private_key = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_share_path = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_ssh_port = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.num_shell_tries = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.nvmet_port_id = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.replication_device = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.report_discard_supported = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.reserved_percentage = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.scst_target_driver = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.storage_protocol = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.target_helper = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.target_ip_address = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.target_port = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.target_prefix = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.target_protocol = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.trace_flags = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.use_chap_auth = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_clear = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_clear_size = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] QuobyteHD.volumes_dir = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_notifications.driver = [] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_notifications.retry = -1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] key_manager.fixed_key = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.barbican_api_version = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.barbican_endpoint = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.barbican_endpoint_type = public {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.barbican_region_name = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.cafile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.collect_timing = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.insecure = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.number_of_retries = 60 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.retry_delay = 1 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.send_service_user_token = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.split_loggers = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.verify_ssl = True {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican.verify_ssl_path = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.auth_section = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.auth_type = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.cafile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.certfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.collect_timing = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.insecure = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.keyfile = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.split_loggers = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] barbican_service_user.timeout = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.approle_role_id = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.approle_secret_id = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.kv_mountpoint = secret {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.kv_path = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.kv_version = 2 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.namespace = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.root_token_id = **** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.ssl_ca_crt_file = None {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.timeout = 60.0 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.use_ssl = False {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 15:53:53 devstack cinder-volume[93610]: DEBUG oslo_service.backend._eventlet.service [None req-7df32234-afe3-413b-b07a-40efcbec5152 None None] ******************************************************************************** {{(pid=93610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 15:53:54 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.830s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:54 devstack cinder-volume[93867]: INFO cinder.volume.driver [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG cinder.volume.driver [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93867) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG oslo_db.sqlalchemy.engines [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93867) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writer thread running {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG cinder.db.api [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Building query based on filter {{(pid=93867) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93867) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:54 devstack cinder-volume[93867]: INFO cinder.keymgr.migration [None req-66d5ae32-83d8-4909-9fcd-908e41973195 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 15:53:54 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:54 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:55 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.635s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:53:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Driver initialization completed successfully. Jun 24 15:53:55 devstack cinder-volume[93867]: INFO cinder.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Initiating service 3 cleanup Jun 24 15:53:55 devstack cinder-volume[93867]: INFO cinder.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Service 3 cleanup completed. Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG cinder.service [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Creating RPC server for service cinder-volume {{(pid=93867) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG cinder.service [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93867) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 15:53:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:53:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:53:55 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:53:55 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:53:56 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jun 24 15:53:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.636s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:53:56 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2bcf8081-22fb-4cb5-9672-8d69facd1b33 None None] Driver post RPC initialization completed successfully. Jun 24 15:54:03 devstack cinder-volume[93610]: DEBUG dbcounter [-] [93610] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:54:05 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:54:06 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=3 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:54:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:54:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 6 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:54:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Flow 'volume_create_manager' (fe92f87b-3791-4ba9-b321-f90f574707b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf41a43-50b1-4e29-9651-a57c5293a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf41a43-50b1-4e29-9651-a57c5293a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-373921081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f1e00e-3b7c-43c7-9210-c2896bae15e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37aa039a9146a3a883d37d442322bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:54:55Z,use_quota=True,user_id='9941240efed9499b9f2c55ae4e06b9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f518a1c-1885-433a-85d9-56f917c4210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f518a1c-1885-433a-85d9-56f917c4210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2efd8c-0131-44b9-b44c-707f3479b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2efd8c-0131-44b9-b44c-707f3479b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f1e00e-3b7c-43c7-9210-c2896bae15e3', 'volume_name': 'volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153b4fbf-597d-47dc-b242-858ca910cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153b4fbf-597d-47dc-b242-858ca910cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c38e8a8-003f-4573-b5cb-d3dc9981319d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:54:55 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Volume b0f1e00e-3b7c-43c7-9210-c2896bae15e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3', 'volume_size': 1} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-373921081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f1e00e-3b7c-43c7-9210-c2896bae15e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be37aa039a9146a3a883d37d442322bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:54:55Z,use_quota=True,user_id='9941240efed9499b9f2c55ae4e06b9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Creating volume b0f1e00e-3b7c-43c7-9210-c2896bae15e3 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:54:55 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:54:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:54:55 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 1073741824 Jun 24 15:54:55 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:54:56 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jun 24 15:54:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 1073741824" returned: 0 in 1.063s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:54:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:54:56 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 Jun 24 15:54:56 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:54:57 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" returned: 0 in 0.937s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c38e8a8-003f-4573-b5cb-d3dc9981319d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98a72ac-0e30-45d4-b8e3-7f6d63993e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:54:57 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Volume volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 (b0f1e00e-3b7c-43c7-9210-c2896bae15e3): created successfully Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98a72ac-0e30-45d4-b8e3-7f6d63993e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:54:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Flow 'volume_create_manager' (fe92f87b-3791-4ba9-b321-f90f574707b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:54:57 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-71c578c4-04b8-4460-871d-41237128bc06 tempest-TaggedAttachmentsTest-1861154602 None] Created volume successfully. Jun 24 15:55:07 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:55:07 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Flow 'volume_create_manager' (27cdd459-14db-47e7-813b-4907f3cd249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7e7b64-fda2-4b15-b904-3bdd4369f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7e7b64-fda2-4b15-b904-3bdd4369f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1111220552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9c8742-6a75-463b-ac53-82a7fadd0290,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161f67caa302495eb91e9a0fb5f75e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:25Z,use_quota=True,user_id='5650db155213444387d03ef5a204f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e72ca3d-d09e-4168-a1e0-e4361c0e6226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e72ca3d-d09e-4168-a1e0-e4361c0e6226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2808481f-c53a-4260-b65e-4ade561186f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2808481f-c53a-4260-b65e-4ade561186f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9c8742-6a75-463b-ac53-82a7fadd0290', 'volume_name': 'volume-cf9c8742-6a75-463b-ac53-82a7fadd0290', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577d1af3-5619-49b1-81cf-23cf4e8df511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577d1af3-5619-49b1-81cf-23cf4e8df511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570de238-84a7-4f26-9ae9-edc08fecc157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Volume cf9c8742-6a75-463b-ac53-82a7fadd0290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9c8742-6a75-463b-ac53-82a7fadd0290', 'volume_size': 1} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1111220552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9c8742-6a75-463b-ac53-82a7fadd0290,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161f67caa302495eb91e9a0fb5f75e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:25Z,use_quota=True,user_id='5650db155213444387d03ef5a204f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Creating volume cf9c8742-6a75-463b-ac53-82a7fadd0290 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:55:25 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:25 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 1073741824 Jun 24 15:55:25 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Flow 'volume_create_manager' (d5186182-1a91-49c7-9a22-5879cdd0fff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2f4423-016e-45ad-b2cb-c01c12e03978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2f4423-016e-45ad-b2cb-c01c12e03978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1852848856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbc9396-04ed-43e2-b804-fbdc976e7b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca675d429d34a3a978e705d13d40324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:25Z,use_quota=True,user_id='f46283a957504255b3aa3602a8215845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e1498b-c495-430c-8c24-19ab73577f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e1498b-c495-430c-8c24-19ab73577f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe23b6ae-95f5-4d01-8108-10304fe4fff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe23b6ae-95f5-4d01-8108-10304fe4fff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbc9396-04ed-43e2-b804-fbdc976e7b84', 'volume_name': 'volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440490d5-f36a-4e21-aad4-d3c9e1480977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440490d5-f36a-4e21-aad4-d3c9e1480977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c02b67-e1be-4c96-9386-a4e540de9aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:25 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Volume ebbc9396-04ed-43e2-b804-fbdc976e7b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84', 'volume_size': 1} Jun 24 15:55:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:26 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 1073741824" returned: 0 in 1.545s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:27 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 Jun 24 15:55:27 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:28 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290" returned: 0 in 1.525s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] <== create_volume: return (3147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.149s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1852848856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbc9396-04ed-43e2-b804-fbdc976e7b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca675d429d34a3a978e705d13d40324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:25Z,use_quota=True,user_id='f46283a957504255b3aa3602a8215845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Creating volume ebbc9396-04ed-43e2-b804-fbdc976e7b84 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:55:28 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:28 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 1073741824 Jun 24 15:55:28 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570de238-84a7-4f26-9ae9-edc08fecc157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9c8742-6a75-463b-ac53-82a7fadd0290', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f00f5c-976d-4e3b-b426-86d2d48d9b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Volume volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 (cf9c8742-6a75-463b-ac53-82a7fadd0290): created successfully Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f00f5c-976d-4e3b-b426-86d2d48d9b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Flow 'volume_create_manager' (27cdd459-14db-47e7-813b-4907f3cd249f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8816bdea-b2cf-4188-b6fc-68ce5b7a0fe7 tempest-VolumesTestJSON-1193111054 None] Created volume successfully. Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Flow 'volume_create_manager' (ae12c97a-65cf-47e1-95b0-0cc6ece1558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32bb247-51c4-4742-ae79-382b73ba636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32bb247-51c4-4742-ae79-382b73ba636d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-815070083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e769c1-2760-4836-9284-9bec1f584d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0981a48269904cd885638b78fddf7c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:29Z,use_quota=True,user_id='0f17513fb3c1416e90540db5ac3f9089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9441188-e2c6-4452-b7ab-fce7b9660b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9441188-e2c6-4452-b7ab-fce7b9660b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3835ce-176a-4c5c-a7d0-3866a7c9874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3835ce-176a-4c5c-a7d0-3866a7c9874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e769c1-2760-4836-9284-9bec1f584d64', 'volume_name': 'volume-f9e769c1-2760-4836-9284-9bec1f584d64', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d326c88d-5246-4248-9b1a-e667fc8655b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d326c88d-5246-4248-9b1a-e667fc8655b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27836a86-dc66-49f3-b99b-80bbc7db64ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:29 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Volume f9e769c1-2760-4836-9284-9bec1f584d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e769c1-2760-4836-9284-9bec1f584d64', 'volume_size': 1} Jun 24 15:55:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:30 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 1073741824" returned: 0 in 1.715s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:30 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 Jun 24 15:55:30 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Flow 'volume_create_manager' (9c19d488-40d2-4af8-a294-a44993ea382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4de3bc6-8370-42ba-ae78-580132923862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4de3bc6-8370-42ba-ae78-580132923862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-376694869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed334fde-9c30-40bc-b3e5-c158823202e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161f67caa302495eb91e9a0fb5f75e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:31Z,use_quota=True,user_id='5650db155213444387d03ef5a204f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9beab7c-0917-4a67-98a5-99440622aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9beab7c-0917-4a67-98a5-99440622aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058a99df-c152-4352-981d-c3331c39ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058a99df-c152-4352-981d-c3331c39ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed334fde-9c30-40bc-b3e5-c158823202e4', 'volume_name': 'volume-ed334fde-9c30-40bc-b3e5-c158823202e4', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e5fad7-41c8-425b-acdb-33c2edfad175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e5fad7-41c8-425b-acdb-33c2edfad175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48355e2-d54c-4bda-82b4-230f75a24a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:30 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Volume ed334fde-9c30-40bc-b3e5-c158823202e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed334fde-9c30-40bc-b3e5-c158823202e4', 'volume_size': 1} Jun 24 15:55:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:31 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84" returned: 0 in 1.133s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] <== create_volume: return (2984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.226s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-815070083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e769c1-2760-4836-9284-9bec1f584d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0981a48269904cd885638b78fddf7c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:29Z,use_quota=True,user_id='0f17513fb3c1416e90540db5ac3f9089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Creating volume f9e769c1-2760-4836-9284-9bec1f584d64 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:55:31 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:31 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 1073741824 Jun 24 15:55:31 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c02b67-e1be-4c96-9386-a4e540de9aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592d609e-76e8-4cd1-a632-a4bf53725f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Volume volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 (ebbc9396-04ed-43e2-b804-fbdc976e7b84): created successfully Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592d609e-76e8-4cd1-a632-a4bf53725f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Flow 'volume_create_manager' (d5186182-1a91-49c7-9a22-5879cdd0fff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:31 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2d278819-4ed1-4b73-ba6b-9e69e9e14c36 tempest-DeleteServersTestJSON-1353103605 None] Created volume successfully. Jun 24 15:55:32 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 1073741824" returned: 0 in 1.024s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:32 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 Jun 24 15:55:32 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:33 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64" returned: 0 in 1.052s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-376694869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed334fde-9c30-40bc-b3e5-c158823202e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161f67caa302495eb91e9a0fb5f75e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:31Z,use_quota=True,user_id='5650db155213444387d03ef5a204f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Creating volume ed334fde-9c30-40bc-b3e5-c158823202e4 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:55:33 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:33 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 1073741824 Jun 24 15:55:33 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27836a86-dc66-49f3-b99b-80bbc7db64ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e769c1-2760-4836-9284-9bec1f584d64', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dfb5dc-77ca-451a-b461-7bb116ccde26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Volume volume-f9e769c1-2760-4836-9284-9bec1f584d64 (f9e769c1-2760-4836-9284-9bec1f584d64): created successfully Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dfb5dc-77ca-451a-b461-7bb116ccde26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Flow 'volume_create_manager' (ae12c97a-65cf-47e1-95b0-0cc6ece1558d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2325fcb3-4c7f-4112-9255-c8e5c05f39d8 tempest-VolumesAdminNegativeTest-1074812278 None] Created volume successfully. Jun 24 15:55:34 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 1073741824" returned: 0 in 1.223s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:35 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 Jun 24 15:55:35 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Acquiring lock "cinder-f9e769c1-2760-4836-9284-9bec1f584d64-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "cinder-f9e769c1-2760-4836-9284-9bec1f584d64-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Acquiring lock "cinder-quobyte-f9e769c1-2760-4836-9284-9bec1f584d64" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "cinder-quobyte-f9e769c1-2760-4836-9284-9bec1f584d64" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:35 devstack cinder-volume[93867]: INFO oslo.privsep.daemon [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxyq3u0bq/privsep.sock'] Jun 24 15:55:35 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxyq3u0bq/privsep.sock Jun 24 15:55:35 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:35 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4" returned: 0 in 0.892s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48355e2-d54c-4bda-82b4-230f75a24a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed334fde-9c30-40bc-b3e5-c158823202e4', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b821e3d3-8b75-4a96-ac0b-9cbfe680ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:36 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Volume volume-ed334fde-9c30-40bc-b3e5-c158823202e4 (ed334fde-9c30-40bc-b3e5-c158823202e4): created successfully Jun 24 15:55:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b821e3d3-8b75-4a96-ac0b-9cbfe680ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Flow 'volume_create_manager' (9c19d488-40d2-4af8-a294-a44993ea382c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8a2ccb19-90f1-428f-bd7b-c87d8d64273e tempest-VolumesTestJSON-1193111054 None] Created volume successfully. Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 15:55:36 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 15:55:37 devstack cinder-volume[93867]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 24 15:55:37 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:37 devstack cinder-volume[93867]: INFO oslo.privsep.daemon [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Spawned new privsep daemon via rootwrap Jun 24 15:55:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Accepted privsep connection to /tmp/tmpxyq3u0bq/privsep.sock {{(pid=93867) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 24 15:55:37 devstack cinder-volume[93867]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 24 15:55:37 devstack cinder-volume[93867]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 24 15:55:37 devstack cinder-volume[93867]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 24 15:55:37 devstack cinder-volume[93867]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95542 Jun 24 15:55:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956475a-5fd7-4195-a3eb-b016400c6b01]: (2,) {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa1f02-026f-4a4f-96a6-9578e0e2294f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:38 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 Jun 24 15:55:38 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Flow 'volume_create_manager' (3da43743-64ab-49ce-87d6-6024907ef305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6004211f-1273-44ce-8b50-85cd39a015f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6004211f-1273-44ce-8b50-85cd39a015f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-79095698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15b5518-e030-4685-b63d-6b0095766aa0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161f67caa302495eb91e9a0fb5f75e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:38Z,use_quota=True,user_id='5650db155213444387d03ef5a204f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff0c72a-7a81-40ef-b453-e5d8191daf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff0c72a-7a81-40ef-b453-e5d8191daf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb9985f-7802-4aa0-a256-6d73125c02b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb9985f-7802-4aa0-a256-6d73125c02b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15b5518-e030-4685-b63d-6b0095766aa0', 'volume_name': 'volume-d15b5518-e030-4685-b63d-6b0095766aa0', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b356c38-cde2-44b8-911b-b59e0b31269a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b356c38-cde2-44b8-911b-b59e0b31269a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b27ab89-42b8-4b96-9090-94eb66de552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:38 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Volume d15b5518-e030-4685-b63d-6b0095766aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15b5518-e030-4685-b63d-6b0095766aa0', 'volume_size': 1} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-79095698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15b5518-e030-4685-b63d-6b0095766aa0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='161f67caa302495eb91e9a0fb5f75e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:55:38Z,use_quota=True,user_id='5650db155213444387d03ef5a204f393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Creating volume d15b5518-e030-4685-b63d-6b0095766aa0 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:55:38 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:55:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:38 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 1073741824 Jun 24 15:55:38 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:39 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:55:39 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:39 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64" returned: 0 in 1.691s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:39 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64 Jun 24 15:55:39 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:40 devstack cinder-volume[93867]: WARNING py.warnings [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 24 15:55:40 devstack cinder-volume[93867]: .first() Jun 24 15:55:40 devstack cinder-volume[93867]: Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:40 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 1073741824" returned: 0 in 1.915s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:40 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 Jun 24 15:55:40 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:40 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.533s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 8 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:55:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:55:41 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f9e769c1-2760-4836-9284-9bec1f584d64" returned: 0 in 1.426s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "cinder-quobyte-f9e769c1-2760-4836-9284-9bec1f584d64" released by "delete_volume" :: held 5.682s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:41 devstack cinder-volume[93867]: WARNING cinder.quota [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:55:41 devstack cinder-volume[93867]: WARNING cinder.quota [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Created reservations ['c348d8f2-c690-4ca0-9728-22c9264be655', 'bc3ca5d5-bd13-41cc-bca1-75d9b204ce3f', '9086c8be-cfd3-4f86-8e46-614557784692', 'c5747672-44e6-4ad7-bd87-d4f09d4a7baf'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:55:41 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0" returned: 0 in 0.777s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] <== create_volume: return (2772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.775s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.198s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:41 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b27ab89-42b8-4b96-9090-94eb66de552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15b5518-e030-4685-b63d-6b0095766aa0', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:41 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b763a4-af12-4a26-8702-7776154a315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f81d73-bc40-4ec1-b9d5-865097c1a3d9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:41 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Volume volume-d15b5518-e030-4685-b63d-6b0095766aa0 (d15b5518-e030-4685-b63d-6b0095766aa0): created successfully Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b763a4-af12-4a26-8702-7776154a315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:55:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Flow 'volume_create_manager' (3da43743-64ab-49ce-87d6-6024907ef305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:55:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-53a638ce-8248-44fd-bb24-0d44344e18a9 tempest-VolumesTestJSON-1193111054 None] Created volume successfully. Jun 24 15:55:41 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 Jun 24 15:55:41 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:42 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.939s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:42 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:55:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Deleted volume successfully. Jun 24 15:55:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d4b91c23-b38c-4b32-8591-1d57488e0fc2 tempest-VolumesAdminNegativeTest-1074812278 None] Lock "cinder-f9e769c1-2760-4836-9284-9bec1f584d64-delete_volume" released by "delete_volume" :: held 7.014s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:42 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84" returned: 0 in 1.158s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.200s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80f39b46-d654-40ce-b166-b6146a96afaa', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 15:55:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-78149adc-4489-431a-90d1-242e37a4895b req-d4067db8-1cab-47eb-9493-4cc68b5f4d98 tempest-DeleteServersTestJSON-1353103605 None] attachment_update completed successfully. Jun 24 15:55:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "cinder-d15b5518-e030-4685-b63d-6b0095766aa0-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-d15b5518-e030-4685-b63d-6b0095766aa0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "cinder-quobyte-d15b5518-e030-4685-b63d-6b0095766aa0" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-quobyte-d15b5518-e030-4685-b63d-6b0095766aa0" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22f807-8d72-4e3a-a193-e3ba4acf0767]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:43 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 Jun 24 15:55:43 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:44 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0" returned: 0 in 1.056s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:44 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0 Jun 24 15:55:44 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:45 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d15b5518-e030-4685-b63d-6b0095766aa0" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-quobyte-d15b5518-e030-4685-b63d-6b0095766aa0" released by "delete_volume" :: held 1.797s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Created reservations ['14b43f7b-488f-4618-b090-231065c0ddbb', '26457c2d-c24f-456a-9f52-f38e00fcd88d', '51d34682-49b6-4e99-add2-a501b3b55aaa', '88942c8c-7a02-441a-95d7-ff97ef1b24f0'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:45 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:55:45 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "cinder-ed334fde-9c30-40bc-b3e5-c158823202e4-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-ed334fde-9c30-40bc-b3e5-c158823202e4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "cinder-quobyte-ed334fde-9c30-40bc-b3e5-c158823202e4" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-quobyte-ed334fde-9c30-40bc-b3e5-c158823202e4" acquired by "delete_volume" :: waited 0.043s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349d399-d386-482d-b529-208865867719]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:46 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.869s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:55:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Deleted volume successfully. Jun 24 15:55:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b1bbd07-b644-44ee-801d-3da3c227bf03 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-d15b5518-e030-4685-b63d-6b0095766aa0-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:46 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 Jun 24 15:55:46 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:47 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:47 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4 Jun 24 15:55:47 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:47 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed334fde-9c30-40bc-b3e5-c158823202e4" returned: 0 in 0.691s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-quobyte-ed334fde-9c30-40bc-b3e5-c158823202e4" released by "delete_volume" :: held 1.547s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:47 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Created reservations ['c9314e82-6023-4e9c-b4d4-108e91eceae2', '92f13e44-46d8-4ff5-9d0e-1130ff7e1379', 'd827c4c5-3da5-44f9-8a35-a84fef73b28a', '1e645ab8-66cd-446b-9b2e-c0259a0b16a7'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:48 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:55:48 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Acquiring lock "cinder-cf9c8742-6a75-463b-ac53-82a7fadd0290-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Lock "cinder-cf9c8742-6a75-463b-ac53-82a7fadd0290-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Acquiring lock "cinder-quobyte-cf9c8742-6a75-463b-ac53-82a7fadd0290" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Lock "cinder-quobyte-cf9c8742-6a75-463b-ac53-82a7fadd0290" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c61932-b86c-4fce-b74b-ef2744de13eb]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:48 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.758s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:55:48 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Deleted volume successfully. Jun 24 15:55:48 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 Jun 24 15:55:48 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ece09882-5ace-4eec-a1eb-208fa8cc57f9 tempest-VolumesTestJSON-1193111054 None] Lock "cinder-ed334fde-9c30-40bc-b3e5-c158823202e4-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:49 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290" returned: 0 in 0.879s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:49 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290 Jun 24 15:55:49 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:50 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cf9c8742-6a75-463b-ac53-82a7fadd0290" returned: 0 in 0.892s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Lock "cinder-quobyte-cf9c8742-6a75-463b-ac53-82a7fadd0290" released by "delete_volume" :: held 1.824s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Created reservations ['ab740f21-d324-4fc0-a702-cb45d95a2c35', 'b5e1ffa3-97c1-4ffe-8ce2-df8e23518e6d', '8d3c2889-5cd4-4520-b2f7-9367c9084906', '4d4b06e3-2a29-41ed-b956-1e27192b4007'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:50 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:55:50 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:51 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.872s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:51 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:55:51 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Deleted volume successfully. Jun 24 15:55:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-78ba99f6-07d8-4078-a3d4-3adcf9e268bd tempest-VolumesTestJSON-1193111054 None] Lock "cinder-cf9c8742-6a75-463b-ac53-82a7fadd0290-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-d9be2a84-1986-406f-9d70-6e6a43d9a6d7 req-38c4d4fa-75b5-4df1-8cd3-048cc1be8ee3 tempest-DeleteServersTestJSON-1353103605 None] Terminate volume connection completed successfully. Jun 24 15:55:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-d9be2a84-1986-406f-9d70-6e6a43d9a6d7 req-38c4d4fa-75b5-4df1-8cd3-048cc1be8ee3 tempest-DeleteServersTestJSON-1353103605 None] Deleting attachment 80f39b46-d654-40ce-b166-b6146a96afaa. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7b4b8fb1-df13-4afd-99b0-f62fd32f5f66 tempest-BackendsCapabilitiesAdminTestsJSON-1079392027 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93867) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66e8642e-4ba1-4dcd-b2aa-52e5c9524383 tempest-BackendsCapabilitiesAdminTestsJSON-1079392027 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93867) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Acquiring lock "cinder-ebbc9396-04ed-43e2-b804-fbdc976e7b84-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Lock "cinder-ebbc9396-04ed-43e2-b804-fbdc976e7b84-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Acquiring lock "cinder-quobyte-ebbc9396-04ed-43e2-b804-fbdc976e7b84" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Lock "cinder-quobyte-ebbc9396-04ed-43e2-b804-fbdc976e7b84" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebf8808-08c6-47ff-83ce-8bdfeb4a26db]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:55:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:56 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 Jun 24 15:55:56 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:57 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84" returned: 0 in 0.830s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:57 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84 Jun 24 15:55:57 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ebbc9396-04ed-43e2-b804-fbdc976e7b84" returned: 0 in 0.729s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:58 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Lock "cinder-quobyte-ebbc9396-04ed-43e2-b804-fbdc976e7b84" released by "delete_volume" :: held 1.641s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Created reservations ['75904d28-07e9-4876-a23d-3a712933fab8', 'b6e62fbb-d47a-43e1-8e0c-6f768d4181cf', '92b8f15b-d61f-4a5b-b8a8-9fac93d7df94', 'eb9fc485-1758-41c3-9389-bffe15d584f2'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:55:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:55:58 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:55:58 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:55:59 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jun 24 15:55:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.844s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:55:59 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:55:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Deleted volume successfully. Jun 24 15:55:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8b3cf8a2-38a0-433e-bb9c-4ea09ab5a9ff tempest-DeleteServersTestJSON-1353103605 None] Lock "cinder-ebbc9396-04ed-43e2-b804-fbdc976e7b84-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:56:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bed4e827-8152-4e99-b2cf-c8d58ed39a0c tempest-GroupSnapshotsV319Test-1280059727 None] Group tempest-GroupSnapshotsV319Test-Group-715835176: creating Jun 24 15:56:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bed4e827-8152-4e99-b2cf-c8d58ed39a0c tempest-GroupSnapshotsV319Test-1280059727 None] Group tempest-GroupSnapshotsV319Test-Group-715835176: created successfully Jun 24 15:56:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bed4e827-8152-4e99-b2cf-c8d58ed39a0c tempest-GroupSnapshotsV319Test-1280059727 None] Create group completed successfully. Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Flow 'volume_create_manager' (064208e8-2f05-49bf-82b1-9de4c7a951e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f541ffeb-a490-4e7c-8d7e-56df0eb98b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f541ffeb-a490-4e7c-8d7e-56df0eb98b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789819926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd36ad02-7f39-40e8-82db-2b39ee1d40d6,host='devstack@QuobyteHD#QuobyteHD',id=cc0447ca-3e81-48f5-b327-74920b6293be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb687ebd77c84507a13718e67a16e84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:07Z,use_quota=True,user_id='43ea03affde54b178879759b2fd95153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcb1cdd5-50e5-4958-81fa-2ce177408ae0),volume_type_id=fcb1cdd5-50e5-4958-81fa-2ce177408ae0)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24f1ecd-cb79-414d-8a3e-e34dd01e9edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24f1ecd-cb79-414d-8a3e-e34dd01e9edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dee4653-aff4-4687-9aa4-74563caa777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dee4653-aff4-4687-9aa4-74563caa777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0447ca-3e81-48f5-b327-74920b6293be', 'volume_name': 'volume-cc0447ca-3e81-48f5-b327-74920b6293be', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa87cca7-4336-48bb-b520-9b2fa7929061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa87cca7-4336-48bb-b520-9b2fa7929061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca07095-eb73-40c3-ba89-ed2ba2b761ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Volume cc0447ca-3e81-48f5-b327-74920b6293be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0447ca-3e81-48f5-b327-74920b6293be', 'volume_size': 1} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd36ad02-7f39-40e8-82db-2b39ee1d40d6,created_at=2026-06-24T13:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789819926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd36ad02-7f39-40e8-82db-2b39ee1d40d6,host='devstack@QuobyteHD#QuobyteHD',id=cc0447ca-3e81-48f5-b327-74920b6293be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb687ebd77c84507a13718e67a16e84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:07Z,use_quota=True,user_id='43ea03affde54b178879759b2fd95153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcb1cdd5-50e5-4958-81fa-2ce177408ae0),volume_type_id=fcb1cdd5-50e5-4958-81fa-2ce177408ae0)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Creating volume cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:56:07 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:56:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:07 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be 1073741824 Jun 24 15:56:07 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:08 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be 1073741824" returned: 0 in 1.128s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:08 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be Jun 24 15:56:08 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:08 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be" returned: 0 in 0.727s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca07095-eb73-40c3-ba89-ed2ba2b761ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0447ca-3e81-48f5-b327-74920b6293be', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2622bd-9d47-4ac0-9fac-b9aef98914fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:08 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Volume volume-cc0447ca-3e81-48f5-b327-74920b6293be (cc0447ca-3e81-48f5-b327-74920b6293be): created successfully Jun 24 15:56:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2622bd-9d47-4ac0-9fac-b9aef98914fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Flow 'volume_create_manager' (064208e8-2f05-49bf-82b1-9de4c7a951e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e236230a-6b35-42c2-b266-9b6b1a28278b tempest-GroupSnapshotsV319Test-1280059727 None] Created volume successfully. Jun 24 15:56:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] GroupSnapshot aef3d30b-bec0-492b-848e-7b7981e61f1d: creating. Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Group snapshot aef3d30b-bec0-492b-848e-7b7981e61f1d: creating. {{(pid=93867) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Creating offline snapshot c675c416-dd54-46ee-8104-dda5fc36635d of volume cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0762ace-a797-4541-8e26-6969c4c2fb2b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:56:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:09 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be Jun 24 15:56:09 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:10 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be" returned: 0 in 0.846s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:10 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d 1G Jun 24 15:56:10 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:11 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d 1G" returned: 0 in 0.911s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0447ca-3e81-48f5-b327-74920b6293be -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:11 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0447ca-3e81-48f5-b327-74920b6293be -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d Jun 24 15:56:11 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:12 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0447ca-3e81-48f5-b327-74920b6293be -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d" returned: 0 in 0.852s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:12 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d is being set with open permissions: ugo+rw: NotImplementedError Jun 24 15:56:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:12 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d Jun 24 15:56:12 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:13 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:13 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info Jun 24 15:56:13 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:13 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info" returned: 0 in 0.772s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:13 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 15:56:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:13 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info Jun 24 15:56:13 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:14 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.info" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.834s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f9d37ca4-58b5-495f-b83a-a57c544eeb8b tempest-GroupSnapshotsV319Test-1280059727 None] group_snapshot aef3d30b-bec0-492b-848e-7b7981e61f1d: created successfully Jun 24 15:56:15 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] group_snapshot aef3d30b-bec0-492b-848e-7b7981e61f1d: deleting Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] group_snapshot aef3d30b-bec0-492b-848e-7b7981e61f1d: deleting {{(pid=93867) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "cinder-quobyte-cc0447ca-3e81-48f5-b327-74920b6293be" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "cinder-quobyte-cc0447ca-3e81-48f5-b327-74920b6293be" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "cinder-quobyte-c675c416-dd54-46ee-8104-dda5fc36635d" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "cinder-quobyte-c675c416-dd54-46ee-8104-dda5fc36635d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Deleting offline snapshot c675c416-dd54-46ee-8104-dda5fc36635d of volume cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] snapshot_file for this snap is: volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f24e05a-1c1c-46ec-9a74-b6de079c19b5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:56:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:15 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d Jun 24 15:56:15 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:16 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d" returned: 0 in 0.995s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0447ca-3e81-48f5-b327-74920b6293be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 15:56:16 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d78b2-45d8-4da0-b4a0-ba9f91bbd561]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:56:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:17 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be Jun 24 15:56:17 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:17 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be" returned: 0 in 0.975s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:17 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d Jun 24 15:56:17 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:18 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d" returned: 0 in 0.974s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:18 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d Jun 24 15:56:18 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:19 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be.c675c416-dd54-46ee-8104-dda5fc36635d" returned: 0 in 0.694s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "cinder-quobyte-c675c416-dd54-46ee-8104-dda5fc36635d" released by "_delete_snapshot" :: held 3.794s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:56:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "cinder-quobyte-cc0447ca-3e81-48f5-b327-74920b6293be" released by "delete_snapshot" :: held 3.823s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:56:19 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=51,cinder:UPDATE=64,cinder:DELETE=6,cinder:INSERT=15 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:56:19 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=56,cinder:UPDATE=63,cinder:INSERT=12,cinder:DELETE=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:56:19 devstack cinder-volume[93867]: WARNING cinder.quota [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-994958595 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-994958595, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:56:19 devstack cinder-volume[93867]: WARNING cinder.quota [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-994958595 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-994958595, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:56:19 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] Created reservations ['35a36234-2f66-4c00-adf7-5168c78e5b29', '13f81976-33be-4b0c-b306-f6ab36b58587', '7f2c5de2-b36d-44a7-8a30-9b00689e302a', 'b0e57742-5af9-4c87-85da-cb07f8cc6e88'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:56:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7a7092d8-a814-4752-be7f-665fcbcb1df9 tempest-GroupSnapshotsV319Test-1280059727 None] group_snapshot aef3d30b-bec0-492b-848e-7b7981e61f1d: deleted successfully Jun 24 15:56:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "cinder-quobyte-cc0447ca-3e81-48f5-b327-74920b6293be" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:56:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "cinder-quobyte-cc0447ca-3e81-48f5-b327-74920b6293be" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:56:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6583596-5d43-4ccd-b034-2c2d99ea9c7b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:56:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:20 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be Jun 24 15:56:20 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:21 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be" returned: 0 in 0.861s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:21 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be Jun 24 15:56:21 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:22 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cc0447ca-3e81-48f5-b327-74920b6293be" returned: 0 in 1.039s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "cinder-quobyte-cc0447ca-3e81-48f5-b327-74920b6293be" released by "delete_volume" :: held 1.992s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:56:22 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Created reservations ['c3de5515-caca-4fda-9af9-b2d9e3863aef'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:56:22 devstack cinder-volume[93867]: WARNING cinder.quota [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-994958595 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-994958595, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:56:22 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Created reservations ['030920b8-c17d-47bd-a9d2-e342ad1b86b5', '31dfcdc4-6443-4de4-97fd-578bee984b5b', '34ab691e-32cd-4500-a350-86441c6516d7', '131b2747-3a1c-4ff2-89c4-e24334dd41a8'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:23 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:56:23 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:23 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.728s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:23 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:56:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b08c3dcb-1b7b-49d5-adbf-d09f5653d210 tempest-GroupSnapshotsV319Test-1280059727 None] Delete group completed successfully. Jun 24 15:56:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54d1ef3-3a04-4041-b918-3836efbf29c5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:56:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:30 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 Jun 24 15:56:30 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:30 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" returned: 0 in 0.897s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfd7c705-a010-4f9a-b94b-155f8516f9e9', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 15:56:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-597065e8-f673-4c73-af5c-b051f0087bb4 req-702b0f75-3857-441d-870c-68712cf939ed tempest-TaggedAttachmentsTest-1861154602 None] attachment_update completed successfully. Jun 24 15:56:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-76ce019e-8ba4-416a-a428-a6648d1d0059 tempest-GroupsTest-1424722223 None] Group tempest-Group1-619908386: creating Jun 24 15:56:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-76ce019e-8ba4-416a-a428-a6648d1d0059 tempest-GroupsTest-1424722223 None] Group tempest-Group1-619908386: created successfully Jun 24 15:56:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-76ce019e-8ba4-416a-a428-a6648d1d0059 tempest-GroupsTest-1424722223 None] Create group completed successfully. Jun 24 15:56:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1436f036-a4a1-4622-bb0c-2542a37f7679 tempest-GroupsTest-1424722223 None] Group tempest-Group2-1039800861: creating Jun 24 15:56:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1436f036-a4a1-4622-bb0c-2542a37f7679 tempest-GroupsTest-1424722223 None] Group tempest-Group2-1039800861: created successfully Jun 24 15:56:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1436f036-a4a1-4622-bb0c-2542a37f7679 tempest-GroupsTest-1424722223 None] Create group completed successfully. Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:39 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:56:39 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Flow 'volume_create_manager' (a3661cac-6d5f-48b3-b282-bd537fd37aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e01940a-f6fe-401b-a8d2-5322fe44e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e01940a-f6fe-401b-a8d2-5322fe44e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1834149449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8de99461-8300-4ee7-b01e-420540e79783,host='devstack@QuobyteHD#QuobyteHD',id=d60c81f7-2fdd-44f5-bd51-b4704e14427a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7833849f37bc410b96ecd55dad071a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:39Z,use_quota=True,user_id='c880bb3927cf4f9b9c58fe9368490780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3bf2bf9-b881-4aa2-a61b-3442869c4679),volume_type_id=f3bf2bf9-b881-4aa2-a61b-3442869c4679)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348dd87c-ae32-4247-9422-357f83984c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348dd87c-ae32-4247-9422-357f83984c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fd8899-59b7-42b5-ab6f-6aea2363b643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fd8899-59b7-42b5-ab6f-6aea2363b643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60c81f7-2fdd-44f5-bd51-b4704e14427a', 'volume_name': 'volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89be74-0405-4c45-952a-197e9200bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d89be74-0405-4c45-952a-197e9200bb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f2472-c161-4524-9375-0af2c7b57195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Volume d60c81f7-2fdd-44f5-bd51-b4704e14427a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a', 'volume_size': 1} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8de99461-8300-4ee7-b01e-420540e79783,created_at=2026-06-24T13:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1834149449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8de99461-8300-4ee7-b01e-420540e79783,host='devstack@QuobyteHD#QuobyteHD',id=d60c81f7-2fdd-44f5-bd51-b4704e14427a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7833849f37bc410b96ecd55dad071a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:39Z,use_quota=True,user_id='c880bb3927cf4f9b9c58fe9368490780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3bf2bf9-b881-4aa2-a61b-3442869c4679),volume_type_id=f3bf2bf9-b881-4aa2-a61b-3442869c4679)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Creating volume d60c81f7-2fdd-44f5-bd51-b4704e14427a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:56:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:56:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:39 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a 1073741824 Jun 24 15:56:39 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-9ba7c434-f673-4c4b-8e39-abe1ee68bdfc req-b14947ce-a951-4a1f-bb32-9e17e968e60c tempest-TaggedAttachmentsTest-1861154602 None] Terminate volume connection completed successfully. Jun 24 15:56:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-9ba7c434-f673-4c4b-8e39-abe1ee68bdfc req-b14947ce-a951-4a1f-bb32-9e17e968e60c tempest-TaggedAttachmentsTest-1861154602 None] Deleting attachment dfd7c705-a010-4f9a-b94b-155f8516f9e9. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 15:56:40 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.773s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:56:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:56:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 8 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:56:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:56:41 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a 1073741824" returned: 0 in 1.894s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:41 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a Jun 24 15:56:41 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:43 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a" returned: 0 in 1.423s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] <== create_volume: return (3391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.394s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f2472-c161-4524-9375-0af2c7b57195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0844733-d495-4ebf-8a82-22fcf51f04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:43 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Volume volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a (d60c81f7-2fdd-44f5-bd51-b4704e14427a): created successfully Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0844733-d495-4ebf-8a82-22fcf51f04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Flow 'volume_create_manager' (a3661cac-6d5f-48b3-b282-bd537fd37aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a159cd40-d0dc-4234-81d1-17867ff811ea tempest-GroupsTest-1424722223 None] Created volume successfully. Jun 24 15:56:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Acquiring lock "cinder-quobyte-d60c81f7-2fdd-44f5-bd51-b4704e14427a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:56:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Lock "cinder-quobyte-d60c81f7-2fdd-44f5-bd51-b4704e14427a" acquired by "delete_volume" :: waited 0.063s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:56:44 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[76004e8d-9ef0-4e76-b43b-b2528dbfa18e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:56:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:44 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a Jun 24 15:56:44 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:45 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a" returned: 0 in 1.229s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:45 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a Jun 24 15:56:45 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:46 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d60c81f7-2fdd-44f5-bd51-b4704e14427a" returned: 0 in 1.007s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Lock "cinder-quobyte-d60c81f7-2fdd-44f5-bd51-b4704e14427a" released by "delete_volume" :: held 2.347s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:56:46 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Created reservations ['c654a245-6feb-452c-a1c4-a2ba3c4f78ad'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:56:46 devstack cinder-volume[93867]: WARNING cinder.quota [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-959808648 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-959808648, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:56:46 devstack cinder-volume[93867]: WARNING cinder.quota [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-959808648 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-959808648, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:56:46 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Created reservations ['a90c3764-d799-44a8-bf70-d8ecd2be9396', '32d9eb13-923a-4186-a946-2c50a09bece7', '8e54c08d-3166-4900-9a0a-01b92f997700', '1b4869a1-f424-4da2-bcad-4158d654ce95'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:47 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:56:47 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Created reservations ['fca6fdff-dc82-4880-8c23-24d93ebd6658'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:48 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:56:48 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:48 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.741s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:48 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:56:48 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-64fe1058-e8af-4035-8a44-15dec2199cfd tempest-GroupsTest-1424722223 None] Delete group completed successfully. Jun 24 15:56:49 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.528s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:49 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:56:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f3bb9438-5100-444a-8a20-efc1f2e15200 tempest-GroupsTest-1424722223 None] Delete group completed successfully. Jun 24 15:56:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f2d2bd9-5257-4ffc-a66a-8281c7d77199 tempest-GroupsTest-1424722223 None] Group tempest-GroupsTest-Group-1959331513: creating Jun 24 15:56:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f2d2bd9-5257-4ffc-a66a-8281c7d77199 tempest-GroupsTest-1424722223 None] Group tempest-GroupsTest-Group-1959331513: created successfully Jun 24 15:56:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f2d2bd9-5257-4ffc-a66a-8281c7d77199 tempest-GroupsTest-1424722223 None] Create group completed successfully. Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Flow 'volume_create_manager' (bd296fad-43a4-4a73-93c1-c7668b431831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1d1859-79ae-42b2-943d-c1c589759029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1d1859-79ae-42b2-943d-c1c589759029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343655531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c10c6d5c-06b7-45ca-9583-c2b4b8c9951f,host='devstack@QuobyteHD#QuobyteHD',id=6667a28c-666c-4141-8480-152f74c5468b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7833849f37bc410b96ecd55dad071a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:52Z,use_quota=True,user_id='c880bb3927cf4f9b9c58fe9368490780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b7e46e-9252-4aea-947e-c4e1a860e509),volume_type_id=75b7e46e-9252-4aea-947e-c4e1a860e509)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9d816-554a-458e-b354-eb8582396a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9d816-554a-458e-b354-eb8582396a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9669ec-2b1a-4403-b6ca-b7a127ca7252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9669ec-2b1a-4403-b6ca-b7a127ca7252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6667a28c-666c-4141-8480-152f74c5468b', 'volume_name': 'volume-6667a28c-666c-4141-8480-152f74c5468b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea596ef0-95a4-4350-a1d7-c31d2b8cd6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea596ef0-95a4-4350-a1d7-c31d2b8cd6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db95617d-759b-4118-8161-840206d858cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:51 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Volume 6667a28c-666c-4141-8480-152f74c5468b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6667a28c-666c-4141-8480-152f74c5468b', 'volume_size': 1} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c10c6d5c-06b7-45ca-9583-c2b4b8c9951f,created_at=2026-06-24T13:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1343655531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c10c6d5c-06b7-45ca-9583-c2b4b8c9951f,host='devstack@QuobyteHD#QuobyteHD',id=6667a28c-666c-4141-8480-152f74c5468b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7833849f37bc410b96ecd55dad071a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:52Z,use_quota=True,user_id='c880bb3927cf4f9b9c58fe9368490780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b7e46e-9252-4aea-947e-c4e1a860e509),volume_type_id=75b7e46e-9252-4aea-947e-c4e1a860e509)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Creating volume 6667a28c-666c-4141-8480-152f74c5468b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:56:51 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:56:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:51 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b 1073741824 Jun 24 15:56:51 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:53 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b 1073741824" returned: 0 in 1.278s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:53 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b Jun 24 15:56:53 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:54 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b" returned: 0 in 0.783s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db95617d-759b-4118-8161-840206d858cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6667a28c-666c-4141-8480-152f74c5468b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a9df75-d679-465f-8272-08a9cebb610f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:54 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Volume volume-6667a28c-666c-4141-8480-152f74c5468b (6667a28c-666c-4141-8480-152f74c5468b): created successfully Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a9df75-d679-465f-8272-08a9cebb610f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:54 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Flow 'volume_create_manager' (bd296fad-43a4-4a73-93c1-c7668b431831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:54 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5c15734a-2818-45d0-aaf6-282fafd93fd5 tempest-GroupsTest-1424722223 None] Created volume successfully. Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Flow 'volume_create_manager' (effbe44c-c08a-44dc-b0c3-095027661813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca974e7-3b88-4efe-a8e3-e69a7f9ff583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca974e7-3b88-4efe-a8e3-e69a7f9ff583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134150271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c10c6d5c-06b7-45ca-9583-c2b4b8c9951f,host='devstack@QuobyteHD#QuobyteHD',id=cb6ccb47-fc1d-4f73-8944-b725a23d37bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7833849f37bc410b96ecd55dad071a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:55Z,use_quota=True,user_id='c880bb3927cf4f9b9c58fe9368490780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b7e46e-9252-4aea-947e-c4e1a860e509),volume_type_id=75b7e46e-9252-4aea-947e-c4e1a860e509)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221e0197-fc12-41c3-a22f-70e1d75e8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221e0197-fc12-41c3-a22f-70e1d75e8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55952db-711d-47ee-930d-6e7d76eb1892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55952db-711d-47ee-930d-6e7d76eb1892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6ccb47-fc1d-4f73-8944-b725a23d37bf', 'volume_name': 'volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66196a30-f0ea-468c-8b6a-2a85b8174d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66196a30-f0ea-468c-8b6a-2a85b8174d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f06e0e2-b057-4fc7-bb31-3836c5868e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:55 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Volume cb6ccb47-fc1d-4f73-8944-b725a23d37bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf', 'volume_size': 1} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c10c6d5c-06b7-45ca-9583-c2b4b8c9951f,created_at=2026-06-24T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2134150271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c10c6d5c-06b7-45ca-9583-c2b4b8c9951f,host='devstack@QuobyteHD#QuobyteHD',id=cb6ccb47-fc1d-4f73-8944-b725a23d37bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7833849f37bc410b96ecd55dad071a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:56:55Z,use_quota=True,user_id='c880bb3927cf4f9b9c58fe9368490780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b7e46e-9252-4aea-947e-c4e1a860e509),volume_type_id=75b7e46e-9252-4aea-947e-c4e1a860e509)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Creating volume cb6ccb47-fc1d-4f73-8944-b725a23d37bf {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:56:55 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:56:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:55 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf 1073741824 Jun 24 15:56:55 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:56 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf 1073741824" returned: 0 in 0.900s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:56:56 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf Jun 24 15:56:56 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:56:56 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f06e0e2-b057-4fc7-bb31-3836c5868e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed872bc-2aae-4d01-b0ed-6e5f7f00edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:56:56 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Volume volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf (cb6ccb47-fc1d-4f73-8944-b725a23d37bf): created successfully Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed872bc-2aae-4d01-b0ed-6e5f7f00edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:56:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Flow 'volume_create_manager' (effbe44c-c08a-44dc-b0c3-095027661813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:56:56 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2a6eb87c-17b2-4ce2-b5ed-e4c40e2e8bf7 tempest-GroupsTest-1424722223 None] Created volume successfully. Jun 24 15:56:57 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c507343e-3a49-46c0-b354-00f0e079d6f1 tempest-GroupsTest-1424722223 None] Update group completed successfully. Jun 24 15:56:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f6d81a77-7c74-4a59-9e0f-816cad6190d9 tempest-GroupsTest-1424722223 None] Update group completed successfully. Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Acquiring lock "cinder-quobyte-6667a28c-666c-4141-8480-152f74c5468b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Lock "cinder-quobyte-6667a28c-666c-4141-8480-152f74c5468b" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aceda92-96a2-4431-97a2-649327f57f19]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:01 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b Jun 24 15:57:01 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Acquiring lock "cinder-b0f1e00e-3b7c-43c7-9210-c2896bae15e3-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Lock "cinder-b0f1e00e-3b7c-43c7-9210-c2896bae15e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Acquiring lock "cinder-quobyte-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Lock "cinder-quobyte-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b26b2-2c58-4d50-aab6-a3468f5a82fe]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:57:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:01 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 Jun 24 15:57:01 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:02 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b" returned: 0 in 0.974s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:02 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b Jun 24 15:57:02 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:02 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" returned: 0 in 0.924s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:02 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3 Jun 24 15:57:02 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Flow 'volume_create_manager' (1c095800-9735-4599-9082-0812e837e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4fc60e-449a-41c1-aac0-ac932d11a837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4fc60e-449a-41c1-aac0-ac932d11a837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1506157208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2561fc1-6071-48c1-939f-244d3529fb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2848ccc1ff846779f6cd7d7db3e7d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:57:03Z,use_quota=True,user_id='5fdeb9ee9f0046c6b753e7f888403c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48db025b-f620-4821-ad3a-6fe9f6e8a2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48db025b-f620-4821-ad3a-6fe9f6e8a2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d703a4b-14b1-4c1e-a272-54993a322add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d703a4b-14b1-4c1e-a272-54993a322add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2561fc1-6071-48c1-939f-244d3529fb19', 'volume_name': 'volume-e2561fc1-6071-48c1-939f-244d3529fb19', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33960c06-fc23-403c-a574-2cb006fcc80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33960c06-fc23-403c-a574-2cb006fcc80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79cf44d-85c5-42a0-9e8a-80f1f6cf4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Volume e2561fc1-6071-48c1-939f-244d3529fb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2561fc1-6071-48c1-939f-244d3529fb19', 'volume_size': 1} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1506157208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2561fc1-6071-48c1-939f-244d3529fb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2848ccc1ff846779f6cd7d7db3e7d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:57:03Z,use_quota=True,user_id='5fdeb9ee9f0046c6b753e7f888403c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Creating volume e2561fc1-6071-48c1-939f-244d3529fb19 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:57:02 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:57:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:02 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 1073741824 Jun 24 15:57:02 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:02 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6667a28c-666c-4141-8480-152f74c5468b" returned: 0 in 0.763s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Lock "cinder-quobyte-6667a28c-666c-4141-8480-152f74c5468b" released by "delete_volume" :: held 1.829s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Acquiring lock "cinder-quobyte-cb6ccb47-fc1d-4f73-8944-b725a23d37bf" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Lock "cinder-quobyte-cb6ccb47-fc1d-4f73-8944-b725a23d37bf" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2db5d-e109-4d56-a855-816a61d2c7ca]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:03 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf Jun 24 15:57:03 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:03 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" returned: 0 in 0.652s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Lock "cinder-quobyte-b0f1e00e-3b7c-43c7-9210-c2896bae15e3" released by "delete_volume" :: held 1.615s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Created reservations ['1539495f-e074-409a-90c7-d86f0a9c9ff1', '6890abb2-0ea3-430f-b649-cb5bc088cccb', '2b7386ad-c8a0-4a3e-9f42-bb95ea9f6255', '40796231-8ad0-4d97-bfd4-6c8476db0cf8'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:03 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:57:03 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:03 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 1073741824" returned: 0 in 0.911s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:03 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf" returned: 0 in 0.815s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:03 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf Jun 24 15:57:03 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:03 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 Jun 24 15:57:03 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:04 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.692s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:57:04 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Deleted volume successfully. Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5350bc2-6729-42f9-9b5e-7661c1966f09 tempest-TaggedAttachmentsTest-1861154602 None] Lock "cinder-b0f1e00e-3b7c-43c7-9210-c2896bae15e3-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:57:04 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cb6ccb47-fc1d-4f73-8944-b725a23d37bf" returned: 0 in 0.707s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:04 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19" returned: 0 in 0.703s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Lock "cinder-quobyte-cb6ccb47-fc1d-4f73-8944-b725a23d37bf" released by "delete_volume" :: held 1.563s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79cf44d-85c5-42a0-9e8a-80f1f6cf4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2561fc1-6071-48c1-939f-244d3529fb19', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b84e1e-104c-44d5-8b21-442e0f2155c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Volume volume-e2561fc1-6071-48c1-939f-244d3529fb19 (e2561fc1-6071-48c1-939f-244d3529fb19): created successfully Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b84e1e-104c-44d5-8b21-442e0f2155c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Flow 'volume_create_manager' (1c095800-9735-4599-9082-0812e837e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:57:04 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-82de1bd5-e6e9-43c7-bb45-00dea0ee1737 tempest-AttachVolumeShelveTestJSON-494893239 None] Created volume successfully. Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Created reservations ['8c44b64c-34d0-4ec7-8654-21e22dba616a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:57:04 devstack cinder-volume[93867]: WARNING cinder.quota [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-928957373 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-928957373, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:57:04 devstack cinder-volume[93867]: WARNING cinder.quota [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-928957373 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-928957373, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Created reservations ['f407a389-1183-4db8-be74-9956c042adcb', 'e6bb4fb4-105e-4282-873a-e2da31c763dd', '81c291c3-d890-4f73-87bd-17d6bb1722d3', '471a708d-83aa-4b4d-b4e7-c474fc1939a7'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:57:04 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Created reservations ['faba70cc-3d02-4f86-83ba-058d6f49f818', '5b83bec1-b9c9-4df5-aec9-b542d0f8c55f', 'ca0a74f3-9dca-47df-b7f5-3b54803f3b74', '701de41b-6354-46e8-8c43-76a063391a06'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:05 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:57:05 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:05 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.677s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:05 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:57:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e486359c-653a-4cb6-8ec3-042ba8985eb9 tempest-GroupsTest-1424722223 None] Delete group completed successfully. Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Flow 'volume_create_manager' (7e7cd5e9-c3f3-43c1-9fc6-576b2ef7a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca139fe-9930-4fc4-af24-dde7cbcac46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca139fe-9930-4fc4-af24-dde7cbcac46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1270810835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b6197f-f868-4d7e-b456-03f2d663c0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5dcf8bec1e445aa28b1ce4c7fdfc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:57:13Z,use_quota=True,user_id='06f9e44b8459435a8df1e7d54a93466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081ac874-3517-4431-b6f2-3de1172842e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081ac874-3517-4431-b6f2-3de1172842e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13a487a-68e7-49ca-8acb-c6738f1489f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13a487a-68e7-49ca-8acb-c6738f1489f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b6197f-f868-4d7e-b456-03f2d663c0b1', 'volume_name': 'volume-97b6197f-f868-4d7e-b456-03f2d663c0b1', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e656c6d1-025e-4a9e-adbb-93efdae6ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e656c6d1-025e-4a9e-adbb-93efdae6ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21044fa-f499-4e54-94c1-c63462b0d032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:13 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Volume 97b6197f-f868-4d7e-b456-03f2d663c0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b6197f-f868-4d7e-b456-03f2d663c0b1', 'volume_size': 1} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1270810835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b6197f-f868-4d7e-b456-03f2d663c0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5dcf8bec1e445aa28b1ce4c7fdfc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:57:13Z,use_quota=True,user_id='06f9e44b8459435a8df1e7d54a93466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Creating volume 97b6197f-f868-4d7e-b456-03f2d663c0b1 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:57:13 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:57:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:13 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 1073741824 Jun 24 15:57:13 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:14 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 1073741824" returned: 0 in 1.433s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:15 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 Jun 24 15:57:15 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:15 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1" returned: 0 in 0.896s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:57:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21044fa-f499-4e54-94c1-c63462b0d032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b6197f-f868-4d7e-b456-03f2d663c0b1', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb3e7da-4ee3-4d7a-966e-3be7f85e8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:15 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Volume volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 (97b6197f-f868-4d7e-b456-03f2d663c0b1): created successfully Jun 24 15:57:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb3e7da-4ee3-4d7a-966e-3be7f85e8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Flow 'volume_create_manager' (7e7cd5e9-c3f3-43c1-9fc6-576b2ef7a80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:57:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4d46d81f-b930-4347-b1b9-2d32ea28f1b3 tempest-ServerActionsTestOtherA-792090752 None] Created volume successfully. Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=77,cinder:INSERT=15,cinder:UPDATE=76,cinder:DELETE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:INSERT=18,cinder:UPDATE=80,cinder:SELECT=63,cinder:DELETE=4 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Flow 'volume_create_manager' (9597f480-4e84-428a-8de8-a4b190e2061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff0783-a043-42ad-af2d-eb6b89b82d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff0783-a043-42ad-af2d-eb6b89b82d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1853020762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c750cb4-b6a4-4f01-b13d-82bd8edf211a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90daf3d1d664c6bb386b6385a16c169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:57:21Z,use_quota=True,user_id='a8f26a781ea24e8c9badcec9d65c3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09126a68-8080-476e-8417-db0076254c95),volume_type_id=09126a68-8080-476e-8417-db0076254c95)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7ac461-6d66-4db2-8a88-0e7a8a5c00ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7ac461-6d66-4db2-8a88-0e7a8a5c00ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee42dae-83e8-432e-bcf5-16d72da19b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee42dae-83e8-432e-bcf5-16d72da19b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c750cb4-b6a4-4f01-b13d-82bd8edf211a', 'volume_name': 'volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4865b7-f782-49aa-b2a7-c1980e06cafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4865b7-f782-49aa-b2a7-c1980e06cafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a9630-fd87-45c2-894f-55854c3aa2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:21 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Volume 1c750cb4-b6a4-4f01-b13d-82bd8edf211a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a', 'volume_size': 1} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1853020762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c750cb4-b6a4-4f01-b13d-82bd8edf211a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90daf3d1d664c6bb386b6385a16c169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:57:21Z,use_quota=True,user_id='a8f26a781ea24e8c9badcec9d65c3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09126a68-8080-476e-8417-db0076254c95),volume_type_id=09126a68-8080-476e-8417-db0076254c95)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Creating volume 1c750cb4-b6a4-4f01-b13d-82bd8edf211a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:57:21 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:57:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:21 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a 1073741824 Jun 24 15:57:21 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:22 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a 1073741824" returned: 0 in 1.115s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:22 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a Jun 24 15:57:22 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:23 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a" returned: 0 in 0.682s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a9630-fd87-45c2-894f-55854c3aa2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cb54f5-27b2-4bc9-b0d4-c99673ec1e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:57:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Volume volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a (1c750cb4-b6a4-4f01-b13d-82bd8edf211a): created successfully Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7cb54f5-27b2-4bc9-b0d4-c99673ec1e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:57:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Flow 'volume_create_manager' (9597f480-4e84-428a-8de8-a4b190e2061f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:57:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d41b07f6-d159-4e40-9eda-d9d1b12de374 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Created volume successfully. Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:24 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:57:24 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-dee54f5e-58b9-46e8-9384-851e5016dac3 req-6f7402f0-7ca1-4ce2-bc27-b927deb9097f tempest-AttachVolumeShelveTestJSON-494893239 None] No connector for attachment 1965e0ef-b5e5-4ca6-be7c-38a2cee7f06e; skipping storage backend terminate_connection call. {{(pid=93867) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 24 15:57:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-dee54f5e-58b9-46e8-9384-851e5016dac3 req-6f7402f0-7ca1-4ce2-bc27-b927deb9097f tempest-AttachVolumeShelveTestJSON-494893239 None] Deleting attachment 1965e0ef-b5e5-4ca6-be7c-38a2cee7f06e. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 15:57:25 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.916s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:57:25 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c9f4b1ff-c5bb-4085-bb4a-62ebba9ab3c1 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Retype volume completed successfully. Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Acquiring lock "cinder-1c750cb4-b6a4-4f01-b13d-82bd8edf211a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "cinder-1c750cb4-b6a4-4f01-b13d-82bd8edf211a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Acquiring lock "cinder-quobyte-1c750cb4-b6a4-4f01-b13d-82bd8edf211a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "cinder-quobyte-1c750cb4-b6a4-4f01-b13d-82bd8edf211a" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd481049-278e-4015-b7a9-403dbdffbcd9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:57:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:25 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a Jun 24 15:57:25 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:26 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a" returned: 0 in 0.983s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:26 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a Jun 24 15:57:26 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:27 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1c750cb4-b6a4-4f01-b13d-82bd8edf211a" returned: 0 in 0.780s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "cinder-quobyte-1c750cb4-b6a4-4f01-b13d-82bd8edf211a" released by "delete_volume" :: held 1.839s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:57:27 devstack cinder-volume[93867]: WARNING cinder.quota [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:57:27 devstack cinder-volume[93867]: WARNING cinder.quota [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Created reservations ['d890b0da-350f-462a-ad80-668d906fbef6', '593365c7-1b4f-4146-84d7-b329be5415ad', '05e9aabc-88f3-4e30-bb34-e85e95048ac6', '6a7205ad-5606-4eee-9a10-799d44ac8c83'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:27 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:57:27 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:28 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.943s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:28 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:57:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Deleted volume successfully. Jun 24 15:57:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eb012404-3e9a-403f-8580-9c43e44fa575 tempest-VolumeRetypeWithoutMigrationTest-1262838092 None] Lock "cinder-1c750cb4-b6a4-4f01-b13d-82bd8edf211a-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:57:37 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=10,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:57:38 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=19,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:57:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:57:39 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:57:39 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:57:40 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jun 24 15:57:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.643s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:57:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:58:06 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:58:06 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:58:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[620eea82-51ef-4ec9-b4aa-044cee5170c3]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:58:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:06 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 Jun 24 15:58:06 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:08 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1" returned: 0 in 1.829s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.908s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-97b6197f-f868-4d7e-b456-03f2d663c0b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f63358f-2225-47c5-a58c-b40e62c2d066', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 15:58:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-d651131a-f8b5-4f6e-8589-c28e6fbff9df req-e15bb244-0438-455c-83f1-9709558ab7e5 tempest-ServerActionsTestOtherA-792090752 None] attachment_update completed successfully. Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:58:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ef4a4773-c8bd-4ba3-b0f5-73ba860fd8cf tempest-ServerActionsTestOtherA-792090752 None] Terminate volume connection completed successfully. Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ef4a4773-c8bd-4ba3-b0f5-73ba860fd8cf tempest-ServerActionsTestOtherA-792090752 None] Deleting attachment 2f63358f-2225-47c5-a58c-b40e62c2d066. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Flow 'volume_create_manager' (82475878-8f6d-4b91-937c-6421531f501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c250bad5-84af-4620-910e-8903ef5acb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c250bad5-84af-4620-910e-8903ef5acb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1755662737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99454457-e306-4ea7-b89e-057b24ed5478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ac1f5272c44700a3f44ef1b6ba3e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:58:19Z,use_quota=True,user_id='1211b22cc09f40788406886e294ad136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567969cf-2bc6-4b1a-a61b-069608eb6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567969cf-2bc6-4b1a-a61b-069608eb6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4362291-d08a-4f6c-9b12-7ebd28e5e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4362291-d08a-4f6c-9b12-7ebd28e5e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99454457-e306-4ea7-b89e-057b24ed5478', 'volume_name': 'volume-99454457-e306-4ea7-b89e-057b24ed5478', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681e75a8-c3e7-4bf4-a185-20059f4c83ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681e75a8-c3e7-4bf4-a185-20059f4c83ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846ac261-f41b-497a-99f5-f35649ca1251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:18 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Volume 99454457-e306-4ea7-b89e-057b24ed5478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99454457-e306-4ea7-b89e-057b24ed5478', 'volume_size': 1} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1755662737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99454457-e306-4ea7-b89e-057b24ed5478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ac1f5272c44700a3f44ef1b6ba3e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:58:19Z,use_quota=True,user_id='1211b22cc09f40788406886e294ad136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Creating volume 99454457-e306-4ea7-b89e-057b24ed5478 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:58:18 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:58:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:18 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 1073741824 Jun 24 15:58:18 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:20 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 1073741824" returned: 0 in 2.258s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:21 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 Jun 24 15:58:21 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:22 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478" returned: 0 in 1.158s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] <== create_volume: return (3535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.539s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.583s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (846ac261-f41b-497a-99f5-f35649ca1251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99454457-e306-4ea7-b89e-057b24ed5478', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1e5f1a-e6f2-48c8-ac3b-359a8ecbca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ccc242-eaae-4215-ad4b-ef2dd9f69147]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:22 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Volume volume-99454457-e306-4ea7-b89e-057b24ed5478 (99454457-e306-4ea7-b89e-057b24ed5478): created successfully Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1e5f1a-e6f2-48c8-ac3b-359a8ecbca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Flow 'volume_create_manager' (82475878-8f6d-4b91-937c-6421531f501f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:58:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2dd1d31c-c85d-45c9-9aca-80caff40f972 tempest-ServerRescueNegativeTestJSON-1205430552 None] Created volume successfully. Jun 24 15:58:22 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 Jun 24 15:58:22 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:23 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1" returned: 0 in 1.183s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.240s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-97b6197f-f868-4d7e-b456-03f2d663c0b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ded668a4-a762-41bd-92b1-12c7a6fae409', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 15:58:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-e0667923-cf9a-4da1-a49e-85c4aad0ff8d req-ab27b5c3-cd14-45e8-9d95-f11a938a2982 tempest-ServerActionsTestOtherA-792090752 None] attachment_update completed successfully. Jun 24 15:58:33 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:58:33 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:39 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:58:39 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:40 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.656s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:58:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:58:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 8 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:58:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (084646fa-0b58-476f-a309-9ed223c6bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c256c807-9334-4e51-96c0-c883c08a69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c256c807-9334-4e51-96c0-c883c08a69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935915346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f23cd0-d47e-4e06-8651-272cd1f20a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:58:43Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8908a460-1a15-47bf-a0ea-b03e6e139606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8908a460-1a15-47bf-a0ea-b03e6e139606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e6e8d5-df14-45d6-8308-9d85aab08b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e6e8d5-df14-45d6-8308-9d85aab08b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f23cd0-d47e-4e06-8651-272cd1f20a9a', 'volume_name': 'volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320c104d-08cc-46c5-99c1-54170f3a6257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320c104d-08cc-46c5-99c1-54170f3a6257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30731894-1211-404d-8744-1aa932232805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:43 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Volume 34f23cd0-d47e-4e06-8651-272cd1f20a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a', 'volume_size': 1} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935915346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f23cd0-d47e-4e06-8651-272cd1f20a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:58:43Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Creating volume 34f23cd0-d47e-4e06-8651-272cd1f20a9a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:58:43 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:58:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:43 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a 1073741824 Jun 24 15:58:43 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:46 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a 1073741824" returned: 0 in 2.984s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:46 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a Jun 24 15:58:46 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:48 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a" returned: 0 in 1.397s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] <== create_volume: return (4577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.582s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30731894-1211-404d-8744-1aa932232805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb62b036-cfd5-4129-890b-482cd1b8b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:58:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Volume volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a (34f23cd0-d47e-4e06-8651-272cd1f20a9a): created successfully Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb62b036-cfd5-4129-890b-482cd1b8b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:58:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (084646fa-0b58-476f-a309-9ed223c6bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:58:48 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5622140f-66b3-46fc-83ae-fb12fbf2b41d tempest-VolumesActionsTest-1741743284 None] Created volume successfully. Jun 24 15:58:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cc550131-560c-4b73-94aa-efa134bd2339 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a" by "attach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cc550131-560c-4b73-94aa-efa134bd2339 tempest-VolumesActionsTest-1741743284 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a" acquired by "attach_volume" :: waited 0.054s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-cc550131-560c-4b73-94aa-efa134bd2339 tempest-VolumesActionsTest-1741743284 None] Attaching volume 34f23cd0-d47e-4e06-8651-272cd1f20a9a to instance 7c73d50d-c7c8-4aea-bf3d-47549c48c71d at mountpoint /dev/vdb on host None. Jun 24 15:58:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-cc550131-560c-4b73-94aa-efa134bd2339 tempest-VolumesActionsTest-1741743284 None] Attach volume completed successfully. Jun 24 15:58:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cc550131-560c-4b73-94aa-efa134bd2339 tempest-VolumesActionsTest-1741743284 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a" released by "attach_volume" :: held 0.234s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Acquiring lock "cinder-99454457-e306-4ea7-b89e-057b24ed5478-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "cinder-99454457-e306-4ea7-b89e-057b24ed5478-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Acquiring lock "cinder-quobyte-99454457-e306-4ea7-b89e-057b24ed5478" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "cinder-quobyte-99454457-e306-4ea7-b89e-057b24ed5478" acquired by "delete_volume" :: waited 0.054s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615c837-2a0c-413e-a53d-81a0d2cbc896]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:50 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 Jun 24 15:58:50 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Acquiring lock "cinder-e2561fc1-6071-48c1-939f-244d3529fb19-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "cinder-e2561fc1-6071-48c1-939f-244d3529fb19-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Acquiring lock "cinder-quobyte-e2561fc1-6071-48c1-939f-244d3529fb19" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "cinder-quobyte-e2561fc1-6071-48c1-939f-244d3529fb19" acquired by "delete_volume" :: waited 0.041s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a78b37-d510-4220-a001-cb44b1975365]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:58:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:51 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 Jun 24 15:58:51 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:51 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-be20a979-acd9-44e2-afb7-a0117bf89e4b tempest-VolumesActionsTest-1339858717 None] Terminate volume connection completed successfully. Jun 24 15:58:51 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478" returned: 0 in 1.683s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:51 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478 Jun 24 15:58:51 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-be20a979-acd9-44e2-afb7-a0117bf89e4b tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-detach_volume" by "detach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-be20a979-acd9-44e2-afb7-a0117bf89e4b tempest-VolumesActionsTest-1339858717 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-be20a979-acd9-44e2-afb7-a0117bf89e4b tempest-VolumesActionsTest-1339858717 None] Detaching volume 34f23cd0-d47e-4e06-8651-272cd1f20a9a from instance 7c73d50d-c7c8-4aea-bf3d-47549c48c71d. Jun 24 15:58:52 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-be20a979-acd9-44e2-afb7-a0117bf89e4b tempest-VolumesActionsTest-1339858717 None] Detach volume completed successfully. Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19" returned: 0 in 1.301s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-be20a979-acd9-44e2-afb7-a0117bf89e4b tempest-VolumesActionsTest-1339858717 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:52 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19 Jun 24 15:58:52 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f0709475-f2d4-497f-90fc-6f326df1a48a tempest-VolumesActionsTest-1741743284 None] Acquiring lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-detach_volume" by "detach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f0709475-f2d4-497f-90fc-6f326df1a48a tempest-VolumesActionsTest-1741743284 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f0709475-f2d4-497f-90fc-6f326df1a48a tempest-VolumesActionsTest-1741743284 None] Volume detach called, but volume not attached. Jun 24 15:58:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f0709475-f2d4-497f-90fc-6f326df1a48a tempest-VolumesActionsTest-1741743284 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:53 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e2561fc1-6071-48c1-939f-244d3529fb19" returned: 0 in 0.856s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "cinder-quobyte-e2561fc1-6071-48c1-939f-244d3529fb19" released by "delete_volume" :: held 2.259s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Created reservations ['5750e36a-fca1-4af6-8288-791d92d5c214', '8ec84eb4-4539-453d-8aa0-9b4cd66e803e', 'f3d6388b-28bf-4917-bfcc-2691ddf26d07', 'c7426f28-6281-47b7-a73b-86a50f195f9c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:58:53 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-99454457-e306-4ea7-b89e-057b24ed5478" returned: 0 in 1.419s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "cinder-quobyte-99454457-e306-4ea7-b89e-057b24ed5478" released by "delete_volume" :: held 3.183s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:53 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:58:53 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Created reservations ['35d6e7ea-57d5-410b-b685-b264d1e3d444', '153a19a6-34c2-4636-9864-4420c98d4289', 'ed7d0eb2-1046-4533-8f53-12d3eff1cab9', '96568702-5c56-4e2e-940b-1310ca2e2ad4'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:53 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:58:53 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Acquiring lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Acquiring lock "cinder-quobyte-34f23cd0-d47e-4e06-8651-272cd1f20a9a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:58:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Lock "cinder-quobyte-34f23cd0-d47e-4e06-8651-272cd1f20a9a" acquired by "delete_volume" :: waited 0.072s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:58:54 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd7e5df-e91d-4d76-afd6-ebe1ec8a0f2c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:58:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:54 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a Jun 24 15:58:54 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:55 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.797s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:55 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:58:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Deleted volume successfully. Jun 24 15:58:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-402280a8-d3c0-467f-bf56-70b6a24479dd tempest-AttachVolumeShelveTestJSON-494893239 None] Lock "cinder-e2561fc1-6071-48c1-939f-244d3529fb19-delete_volume" released by "delete_volume" :: held 4.561s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:55 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 2.251s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:55 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:58:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Deleted volume successfully. Jun 24 15:58:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f674689f-4bb2-47e5-8881-cb02c9ae5c1b tempest-ServerRescueNegativeTestJSON-1205430552 None] Lock "cinder-99454457-e306-4ea7-b89e-057b24ed5478-delete_volume" released by "delete_volume" :: held 5.826s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a" returned: 0 in 2.474s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:56 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:56 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a Jun 24 15:58:56 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:57 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34f23cd0-d47e-4e06-8651-272cd1f20a9a" returned: 0 in 1.269s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Lock "cinder-quobyte-34f23cd0-d47e-4e06-8651-272cd1f20a9a" released by "delete_volume" :: held 3.902s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Created reservations ['0d2c6a7e-5d10-4e07-9e7e-341b894366d4', 'f6cb2638-8ae2-4fa5-a3e5-bdd803e94b37', 'df62b0ac-b429-4759-8b04-ea45307b4cfa', 'a13df62f-6721-4eb1-bdcf-20fa80c4a6c5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:58:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:58:58 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:58:58 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:58:59 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jun 24 15:58:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.556s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:58:59 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:58:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Deleted volume successfully. Jun 24 15:59:00 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-21b0ef20-8ef2-4542-a4d6-adaeeece4fdb tempest-VolumesActionsTest-1741743284 None] Lock "cinder-34f23cd0-d47e-4e06-8651-272cd1f20a9a-delete_volume" released by "delete_volume" :: held 6.213s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (fdae2c1c-5f52-4246-9c58-69b2823ad35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2744122-ddf0-48ee-97a5-cfa1b4a2413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2744122-ddf0-48ee-97a5-cfa1b4a2413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942347757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e09888-e9b3-4e89-90b8-c15862338386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:07Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c07a86a-087b-4f99-baa4-48064b2ff404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c07a86a-087b-4f99-baa4-48064b2ff404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119f1f5c-6932-4663-86a0-44b2c2166cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119f1f5c-6932-4663-86a0-44b2c2166cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e09888-e9b3-4e89-90b8-c15862338386', 'volume_name': 'volume-e5e09888-e9b3-4e89-90b8-c15862338386', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8d7934-8ad1-492e-9f39-14b341705339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8d7934-8ad1-492e-9f39-14b341705339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef3b72d-1f58-472e-95f1-ba3c758a642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Volume e5e09888-e9b3-4e89-90b8-c15862338386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e09888-e9b3-4e89-90b8-c15862338386', 'volume_size': 1} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942347757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e09888-e9b3-4e89-90b8-c15862338386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:07Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Creating volume e5e09888-e9b3-4e89-90b8-c15862338386 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:07 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:07 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 1073741824 Jun 24 15:59:07 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:08 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 1073741824" returned: 0 in 0.931s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:08 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 Jun 24 15:59:08 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:09 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386" returned: 0 in 0.717s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef3b72d-1f58-472e-95f1-ba3c758a642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e09888-e9b3-4e89-90b8-c15862338386', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61ea76b-7e7b-49db-aa8b-04964a382d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:09 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Volume volume-e5e09888-e9b3-4e89-90b8-c15862338386 (e5e09888-e9b3-4e89-90b8-c15862338386): created successfully Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61ea76b-7e7b-49db-aa8b-04964a382d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (fdae2c1c-5f52-4246-9c58-69b2823ad35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bbc8bff4-6e04-4355-b614-4869145098f9 tempest-VolumesActionsTest-1741743284 None] Created volume successfully. Jun 24 15:59:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-e5e09888-e9b3-4e89-90b8-c15862338386-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Lock "cinder-e5e09888-e9b3-4e89-90b8-c15862338386-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-quobyte-e5e09888-e9b3-4e89-90b8-c15862338386" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-e5e09888-e9b3-4e89-90b8-c15862338386" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e6c4dd-5a61-41fb-8d95-582e5e09831f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:11 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 Jun 24 15:59:11 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:11 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386" returned: 0 in 1.095s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:11 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386 Jun 24 15:59:11 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:12 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e5e09888-e9b3-4e89-90b8-c15862338386" returned: 0 in 0.919s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-e5e09888-e9b3-4e89-90b8-c15862338386" released by "delete_volume" :: held 2.086s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:12 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Created reservations ['c733b638-8a44-484e-99a6-d8c4ed022881', '7a58e080-02bf-4149-8c93-edadaa2c8f44', 'e9b9603f-105f-4c0b-bec1-261bfa88bf7e', '4bf7edc0-47fe-45ae-bcf7-b3a0ec4c1075'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:13 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:13 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:13 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.738s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Deleted volume successfully. Jun 24 15:59:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-827a8611-c9ce-49de-9f21-0807c3665886 tempest-VolumesActionsTest-1339858717 None] Lock "cinder-e5e09888-e9b3-4e89-90b8-c15862338386-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-548658bb-7aef-479f-868c-8712087a498f req-716b24c4-65a6-47b9-9352-443f2e058933 tempest-ServerActionsTestOtherA-792090752 None] Terminate volume connection completed successfully. Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-548658bb-7aef-479f-868c-8712087a498f req-716b24c4-65a6-47b9-9352-443f2e058933 tempest-ServerActionsTestOtherA-792090752 None] Deleting attachment ded668a4-a762-41bd-92b1-12c7a6fae409. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (79cf67d6-4602-4964-9d4b-d5d7948bcd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8e5e61-10f4-4230-9bdd-1be9f115e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8e5e61-10f4-4230-9bdd-1be9f115e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-986382730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72731f7f-42f5-402a-ac79-3b5f0b13a580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:15Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bb9d9c-04c0-4c78-ac72-91a60ddc1b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bb9d9c-04c0-4c78-ac72-91a60ddc1b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8a6a53-6194-438a-86c4-e60510aaad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8a6a53-6194-438a-86c4-e60510aaad33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72731f7f-42f5-402a-ac79-3b5f0b13a580', 'volume_name': 'volume-72731f7f-42f5-402a-ac79-3b5f0b13a580', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bc9021-4d22-4e3b-9058-843cd53cc67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bc9021-4d22-4e3b-9058-843cd53cc67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c84016-3eb2-48d7-adc4-c220c98e5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:14 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Volume 72731f7f-42f5-402a-ac79-3b5f0b13a580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72731f7f-42f5-402a-ac79-3b5f0b13a580', 'volume_size': 1} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-986382730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72731f7f-42f5-402a-ac79-3b5f0b13a580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:15Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Creating volume 72731f7f-42f5-402a-ac79-3b5f0b13a580 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:14 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:14 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 1073741824 Jun 24 15:59:14 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:16 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 1073741824" returned: 0 in 1.176s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:16 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 Jun 24 15:59:16 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:16 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580" returned: 0 in 0.826s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c84016-3eb2-48d7-adc4-c220c98e5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72731f7f-42f5-402a-ac79-3b5f0b13a580', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0128313e-2e5e-4ed6-bdc5-5939d62c45ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:16 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Volume volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 (72731f7f-42f5-402a-ac79-3b5f0b13a580): created successfully Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0128313e-2e5e-4ed6-bdc5-5939d62c45ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (79cf67d6-4602-4964-9d4b-d5d7948bcd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-70e7f3a1-c8ad-476b-9de1-a22893676676 tempest-VolumesActionsTest-1741743284 None] Created volume successfully. Jun 24 15:59:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-72731f7f-42f5-402a-ac79-3b5f0b13a580-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Lock "cinder-72731f7f-42f5-402a-ac79-3b5f0b13a580-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-quobyte-72731f7f-42f5-402a-ac79-3b5f0b13a580" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-72731f7f-42f5-402a-ac79-3b5f0b13a580" acquired by "delete_volume" :: waited 0.032s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:18 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2484a2-8eba-4473-871d-ec62a3e03213]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:18 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 Jun 24 15:59:18 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:19 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580" returned: 0 in 1.061s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:19 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580 Jun 24 15:59:19 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:20 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-72731f7f-42f5-402a-ac79-3b5f0b13a580" returned: 0 in 0.828s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-72731f7f-42f5-402a-ac79-3b5f0b13a580" released by "delete_volume" :: held 1.990s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Created reservations ['3b8d1655-562a-49c1-b39a-8255824815c8', '0ce0bf5c-170c-4e54-9c37-c64eca926f50', 'c22a52e8-9c28-44bb-8a56-9cc63d345182', 'db37b30e-a088-4d0d-8be6-6173566811ae'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:20 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:20 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:21 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.734s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:21 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Deleted volume successfully. Jun 24 15:59:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-372ad9b9-e89b-41ef-abeb-27bbb427640d tempest-VolumesActionsTest-1339858717 None] Lock "cinder-72731f7f-42f5-402a-ac79-3b5f0b13a580-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (86f45023-e296-4f93-9f61-0d1abb998db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e4f1a6-0b57-495d-b5c4-63a6a2f64b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e4f1a6-0b57-495d-b5c4-63a6a2f64b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-853506426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ef98ae-8740-44ab-8288-8c697d8f387b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:22Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c760382-7f12-4354-ae23-3e36cbe72240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c760382-7f12-4354-ae23-3e36cbe72240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862f6a93-8ad8-4eb2-a9b8-6f7e70783130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862f6a93-8ad8-4eb2-a9b8-6f7e70783130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ef98ae-8740-44ab-8288-8c697d8f387b', 'volume_name': 'volume-d4ef98ae-8740-44ab-8288-8c697d8f387b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d46a2ca-7cf0-41f1-aa17-a6da6da69388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d46a2ca-7cf0-41f1-aa17-a6da6da69388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc60b24c-2b31-4edf-90ec-409d479847d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:22 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Volume d4ef98ae-8740-44ab-8288-8c697d8f387b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ef98ae-8740-44ab-8288-8c697d8f387b', 'volume_size': 1} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-853506426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ef98ae-8740-44ab-8288-8c697d8f387b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:22Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Creating volume d4ef98ae-8740-44ab-8288-8c697d8f387b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:22 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:22 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b 1073741824 Jun 24 15:59:22 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:23 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b 1073741824" returned: 0 in 0.980s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:23 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b Jun 24 15:59:23 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Flow 'volume_create_manager' (7ab305ce-2104-47e9-b3ff-7cff590d8616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376432cd-9851-4cb7-8c1d-b0477cc8032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376432cd-9851-4cb7-8c1d-b0477cc8032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2073105746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea8459f-7832-48d0-8340-0ead06b4d06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb535b90e72e4b91b235510153ea5a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:23Z,use_quota=True,user_id='0d8686ac05b34b0885d331ac822b9e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a58c16d-4abe-4137-bb75-89bd7dd888c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a58c16d-4abe-4137-bb75-89bd7dd888c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64bee58-8375-4404-936f-231b39ca6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64bee58-8375-4404-936f-231b39ca6726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea8459f-7832-48d0-8340-0ead06b4d06b', 'volume_name': 'volume-dea8459f-7832-48d0-8340-0ead06b4d06b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a28a1bc-ea5b-4f49-9d7d-fe6c2c5d7514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a28a1bc-ea5b-4f49-9d7d-fe6c2c5d7514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b038416f-19cd-43db-95c7-2ca45eec9df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Volume dea8459f-7832-48d0-8340-0ead06b4d06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea8459f-7832-48d0-8340-0ead06b4d06b', 'volume_size': 1} Jun 24 15:59:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:24 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b" returned: 0 in 0.714s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2073105746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea8459f-7832-48d0-8340-0ead06b4d06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb535b90e72e4b91b235510153ea5a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:23Z,use_quota=True,user_id='0d8686ac05b34b0885d331ac822b9e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Creating volume dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:24 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc60b24c-2b31-4edf-90ec-409d479847d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ef98ae-8740-44ab-8288-8c697d8f387b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:24 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b 1073741824 Jun 24 15:59:24 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c29b1f-0661-4342-9512-db4a7f27d12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:24 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Volume volume-d4ef98ae-8740-44ab-8288-8c697d8f387b (d4ef98ae-8740-44ab-8288-8c697d8f387b): created successfully Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c29b1f-0661-4342-9512-db4a7f27d12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (86f45023-e296-4f93-9f61-0d1abb998db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-49ff5b98-23af-465e-84cd-126910f41b57 tempest-VolumesActionsTest-1741743284 None] Created volume successfully. Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-d4ef98ae-8740-44ab-8288-8c697d8f387b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Lock "cinder-d4ef98ae-8740-44ab-8288-8c697d8f387b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-quobyte-d4ef98ae-8740-44ab-8288-8c697d8f387b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-d4ef98ae-8740-44ab-8288-8c697d8f387b" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5bb802-2637-4e9f-a2c6-892f8efaf933]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:24 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b Jun 24 15:59:24 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:25 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b 1073741824" returned: 0 in 1.004s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "cinder-97b6197f-f868-4d7e-b456-03f2d663c0b1-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:25 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b Jun 24 15:59:25 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Lock "cinder-97b6197f-f868-4d7e-b456-03f2d663c0b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "cinder-quobyte-97b6197f-f868-4d7e-b456-03f2d663c0b1" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Lock "cinder-quobyte-97b6197f-f868-4d7e-b456-03f2d663c0b1" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[810948eb-8492-4a3f-9dd3-f2a36dc28778]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:25 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 Jun 24 15:59:25 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:25 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b" returned: 0 in 0.892s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:25 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b Jun 24 15:59:25 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:25 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b" returned: 0 in 0.707s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b038416f-19cd-43db-95c7-2ca45eec9df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea8459f-7832-48d0-8340-0ead06b4d06b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b54597-3b69-4a5e-927a-74fd18fc74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:25 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Volume volume-dea8459f-7832-48d0-8340-0ead06b4d06b (dea8459f-7832-48d0-8340-0ead06b4d06b): created successfully Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b54597-3b69-4a5e-927a-74fd18fc74ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Flow 'volume_create_manager' (7ab305ce-2104-47e9-b3ff-7cff590d8616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:25 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-7067b3ba-8376-442b-a950-a55209bf8c46 req-d791a130-3e49-434a-bff7-f88e1dff73da tempest-VolumesSnapshotsTestJSON-1352765189 None] Created volume successfully. Jun 24 15:59:26 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1" returned: 0 in 0.861s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:26 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1 Jun 24 15:59:26 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Creating offline snapshot 18fa11e8-c85f-416a-98f8-8666a260b8af of volume dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e82256-cd52-4ca1-bded-25bd251730e2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:26 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4ef98ae-8740-44ab-8288-8c697d8f387b" returned: 0 in 0.841s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-d4ef98ae-8740-44ab-8288-8c697d8f387b" released by "delete_volume" :: held 1.813s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:26 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b Jun 24 15:59:26 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Created reservations ['32c307af-e9fc-4b6e-930f-42b00b58add2', 'ba3f8ed1-0e2b-4d7f-8660-28da5e6e0a0e', 'b776c2bc-d061-4216-b80b-4f5e64708c5c', '8b811ad7-8f47-4ec8-8fa7-493129808370'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:26 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:26 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:26 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-97b6197f-f868-4d7e-b456-03f2d663c0b1" returned: 0 in 0.856s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Lock "cinder-quobyte-97b6197f-f868-4d7e-b456-03f2d663c0b1" released by "delete_volume" :: held 1.765s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Created reservations ['322ae3da-4ebf-4676-8398-96652e0221a6', '41f53ae1-4ff9-47c3-af8b-857b44a9c82e', '10c4e7f9-58ca-4d55-8785-2d486be6eab2', 'a96680d0-6a53-48b7-9af9-d0b28f0e453c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:27 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:27 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:27 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b" returned: 0 in 1.317s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:27 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af 1G Jun 24 15:59:27 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:27 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.197s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:27 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Deleted volume successfully. Jun 24 15:59:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6b615a8a-ad20-4284-aca4-08e733847fde tempest-VolumesActionsTest-1339858717 None] Lock "cinder-d4ef98ae-8740-44ab-8288-8c697d8f387b-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (1d03c3c6-039e-419c-bf20-bf960e524aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b8867e-a70a-48a2-beb0-43484a72331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b8867e-a70a-48a2-beb0-43484a72331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-755891482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223c755-680f-469b-a71b-f2cfb8540e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:28Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9abbe-a3cd-4599-863b-b5cd2a2bf277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf9abbe-a3cd-4599-863b-b5cd2a2bf277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c392d5-2734-401d-a584-e547a6e5fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c392d5-2734-401d-a584-e547a6e5fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e223c755-680f-469b-a71b-f2cfb8540e0c', 'volume_name': 'volume-e223c755-680f-469b-a71b-f2cfb8540e0c', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb68519-6232-4691-81c0-3928e0c13c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb68519-6232-4691-81c0-3928e0c13c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5e2c24-b84e-4735-8e94-d39a5ae74103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Volume e223c755-680f-469b-a71b-f2cfb8540e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e223c755-680f-469b-a71b-f2cfb8540e0c', 'volume_size': 1} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:28 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.154s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Deleted volume successfully. Jun 24 15:59:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bee9b0c4-0e60-47d0-b1c5-1dfb8a412a05 tempest-ServerActionsTestOtherA-792090752 None] Lock "cinder-97b6197f-f868-4d7e-b456-03f2d663c0b1-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:29 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af 1G" returned: 0 in 1.466s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea8459f-7832-48d0-8340-0ead06b4d06b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:29 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea8459f-7832-48d0-8340-0ead06b4d06b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af Jun 24 15:59:29 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:30 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea8459f-7832-48d0-8340-0ead06b4d06b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af" returned: 0 in 0.905s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:30 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af is being set with open permissions: ugo+rw Jun 24 15:59:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:30 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af Jun 24 15:59:30 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:30 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af" returned: 0 in 0.662s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:30 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info Jun 24 15:59:30 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:31 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:31 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info is being set with open permissions: ugo+rw Jun 24 15:59:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:31 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info Jun 24 15:59:31 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:32 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.info" returned: 0 in 0.662s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.918s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-755891482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e223c755-680f-469b-a71b-f2cfb8540e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:28Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Creating volume e223c755-680f-469b-a71b-f2cfb8540e0c {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:32 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:32 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c 1073741824 Jun 24 15:59:32 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-91c6c879-b65e-46fc-b60f-6f5fee8aea60 req-9f1f912f-43f8-4945-93a5-d3f35cd308ed tempest-VolumesSnapshotsTestJSON-1352765189 None] Create snapshot completed successfully Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "cinder-18fa11e8-c85f-416a-98f8-8666a260b8af-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-18fa11e8-c85f-416a-98f8-8666a260b8af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "cinder-quobyte-dea8459f-7832-48d0-8340-0ead06b4d06b" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-quobyte-dea8459f-7832-48d0-8340-0ead06b4d06b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "cinder-quobyte-18fa11e8-c85f-416a-98f8-8666a260b8af" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-quobyte-18fa11e8-c85f-416a-98f8-8666a260b8af" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Deleting offline snapshot 18fa11e8-c85f-416a-98f8-8666a260b8af of volume dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] snapshot_file for this snap is: volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a888c81-d493-4d5e-8710-ac26aaf47364]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:32 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af Jun 24 15:59:32 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:33 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c 1073741824" returned: 0 in 0.988s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:33 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c Jun 24 15:59:33 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:33 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af" returned: 0 in 0.805s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea8459f-7832-48d0-8340-0ead06b4d06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a862432-30e3-4c26-a49c-748378187828]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:33 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b Jun 24 15:59:33 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:33 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=65,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5e2c24-b84e-4735-8e94-d39a5ae74103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e223c755-680f-469b-a71b-f2cfb8540e0c', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9a6200-4716-47cc-84e2-fefa9283de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=53,cinder:UPDATE=74,cinder:INSERT=15,cinder:DELETE=8 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 15:59:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Volume volume-e223c755-680f-469b-a71b-f2cfb8540e0c (e223c755-680f-469b-a71b-f2cfb8540e0c): created successfully Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9a6200-4716-47cc-84e2-fefa9283de4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (1d03c3c6-039e-419c-bf20-bf960e524aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-41128089-0e0a-40a8-b621-e779799e35ad tempest-VolumesActionsTest-1741743284 None] Created volume successfully. Jun 24 15:59:34 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b" returned: 0 in 0.804s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:34 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af Jun 24 15:59:34 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-e223c755-680f-469b-a71b-f2cfb8540e0c-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Lock "cinder-e223c755-680f-469b-a71b-f2cfb8540e0c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Acquiring lock "cinder-quobyte-e223c755-680f-469b-a71b-f2cfb8540e0c" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-e223c755-680f-469b-a71b-f2cfb8540e0c" acquired by "delete_volume" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726d19c-4d85-4e87-ab65-4b445b564e32]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:34 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c Jun 24 15:59:34 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:35 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af" returned: 0 in 0.844s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:35 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af Jun 24 15:59:35 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:35 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c" returned: 0 in 1.190s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:35 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c Jun 24 15:59:35 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:36 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b.18fa11e8-c85f-416a-98f8-8666a260b8af" returned: 0 in 1.134s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-quobyte-18fa11e8-c85f-416a-98f8-8666a260b8af" released by "_delete_snapshot" :: held 3.739s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-quobyte-dea8459f-7832-48d0-8340-0ead06b4d06b" released by "delete_snapshot" :: held 3.779s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:36 devstack cinder-volume[93867]: WARNING cinder.quota [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG cinder.quota [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Created reservations ['33662eec-1bf1-4116-a148-9a46ab487cb5', '3c79a9d0-504d-4f19-9799-62b7318ad580', '44269a24-14bf-451d-a4e6-214fb842a66d', '200ba1c3-dc20-4df5-b344-83253770e6c4'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Delete snapshot completed successfully. Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-e852e8a7-6c20-48ee-b14e-22ab6e724226 req-ad79479b-6276-43b1-a583-e08ed0c0cd2f tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-18fa11e8-c85f-416a-98f8-8666a260b8af-delete_snapshot" released by "delete_snapshot" :: held 4.152s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:36 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e223c755-680f-469b-a71b-f2cfb8540e0c" returned: 0 in 1.071s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Lock "cinder-quobyte-e223c755-680f-469b-a71b-f2cfb8540e0c" released by "delete_volume" :: held 2.329s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "cinder-dea8459f-7832-48d0-8340-0ead06b4d06b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-dea8459f-7832-48d0-8340-0ead06b4d06b-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Created reservations ['824dec56-30e8-431d-a7f8-7e7470941b96', '174055a5-1a9f-4f8a-b09d-2819c82bbcf6', '92f95cd2-5820-40f9-955c-883649f76408', '11a69aa1-fd66-4c46-b328-1e62f0eda1fd'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "cinder-quobyte-dea8459f-7832-48d0-8340-0ead06b4d06b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-quobyte-dea8459f-7832-48d0-8340-0ead06b4d06b" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed270746-c7a9-4dde-aa66-d956fbfe951e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:37 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:37 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:37 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b Jun 24 15:59:37 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:38 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.267s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:38 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:38 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Deleted volume successfully. Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b" returned: 0 in 1.292s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bba4123a-c47f-4655-bb56-616dbe3cc5ff tempest-VolumesActionsTest-1339858717 None] Lock "cinder-e223c755-680f-469b-a71b-f2cfb8540e0c-delete_volume" released by "delete_volume" :: held 4.044s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:38 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b Jun 24 15:59:38 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (ee925616-1a93-4f70-90ea-371ef43bb464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88316e33-71d1-4590-abc7-428b8e2b3f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88316e33-71d1-4590-abc7-428b8e2b3f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-501202179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed64f26d-c29c-4e0a-9f14-acd5677eb2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:39Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7eee30-c6b3-4703-b011-72688e6fa2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7eee30-c6b3-4703-b011-72688e6fa2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01665593-078d-46d0-8cd9-2cfc9ea6da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01665593-078d-46d0-8cd9-2cfc9ea6da08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed64f26d-c29c-4e0a-9f14-acd5677eb2a1', 'volume_name': 'volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90218be-ed51-40e9-bb72-9e7e85861246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90218be-ed51-40e9-bb72-9e7e85861246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baed3347-99b6-4dd7-8ce0-5270ca95eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Volume ed64f26d-c29c-4e0a-9f14-acd5677eb2a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1', 'volume_size': 1} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-501202179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed64f26d-c29c-4e0a-9f14-acd5677eb2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b5b21cf98a416abe3bab8e189f0bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:39Z,use_quota=True,user_id='9164fb8342f94d839d15e2acf3af74c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Creating volume ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:39 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 1073741824 Jun 24 15:59:39 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:39 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:39 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:39 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dea8459f-7832-48d0-8340-0ead06b4d06b" returned: 0 in 1.279s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-quobyte-dea8459f-7832-48d0-8340-0ead06b4d06b" released by "delete_volume" :: held 2.699s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:39 devstack cinder-volume[93867]: DEBUG cinder.quota [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Created reservations ['4c3f789c-94b0-4dbf-aeeb-f42a28d20273', 'd539f7dc-385b-4677-a83e-6f0c29eabbd1', 'ca2c1646-df60-4692-81ae-e1ae42079e7c', '95275224-6893-4c85-8eca-8d675b38a7d8'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:40 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:40 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:40 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.371s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 8 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 15:59:40 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 1073741824" returned: 0 in 1.885s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:41 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 Jun 24 15:59:41 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.497s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:41 devstack cinder-volume[93867]: DEBUG cinder.manager [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:41 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Deleted volume successfully. Jun 24 15:59:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-be645c84-ef27-4358-9a0d-f0a682206dfb req-62c726ab-0ba9-4731-9557-93afa79e3738 tempest-VolumesSnapshotsTestJSON-1352765189 None] Lock "cinder-dea8459f-7832-48d0-8340-0ead06b4d06b-delete_volume" released by "delete_volume" :: held 4.639s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1" returned: 0 in 0.992s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] <== create_volume: return (2985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:42 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baed3347-99b6-4dd7-8ce0-5270ca95eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f12526b-25e7-4311-b6ce-49a806ec7eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:42 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Volume volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 (ed64f26d-c29c-4e0a-9f14-acd5677eb2a1): created successfully Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f12526b-25e7-4311-b6ce-49a806ec7eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Flow 'volume_create_manager' (ee925616-1a93-4f70-90ea-371ef43bb464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a03eac9d-7c55-46d9-b94c-4278695470e0 tempest-VolumesActionsTest-1741743284 None] Created volume successfully. Jun 24 15:59:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Acquiring lock "cinder-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Lock "cinder-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Acquiring lock "cinder-quobyte-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 15:59:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Lock "cinder-quobyte-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1" acquired by "delete_volume" :: waited 0.078s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 15:59:44 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[81132ee4-fdd6-473d-bc78-706cdbf79e85]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:44 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 Jun 24 15:59:44 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:45 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1" returned: 0 in 1.013s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:45 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1 Jun 24 15:59:45 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:46 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1" returned: 0 in 0.710s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Lock "cinder-quobyte-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1" released by "delete_volume" :: held 1.795s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Created reservations ['7cd9e031-e2be-472d-b64d-4a8a7148dc05', 'de9cd4e2-dcab-464c-b6a8-f6623a826bf6', 'f7dba657-93e0-4e5c-9ff6-9f07371d3a86', 'fd9e47f2-adc5-496a-9767-6aeac8ccd6ac'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:46 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 15:59:46 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:47 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.002s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:47 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 15:59:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Deleted volume successfully. Jun 24 15:59:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4feeca81-53ce-4fd2-bbd8-d096c388f00d tempest-VolumesActionsTest-1741743284 None] Lock "cinder-ed64f26d-c29c-4e0a-9f14-acd5677eb2a1-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 15:59:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-64d84bed-1202-4650-989f-eb00177f2b6b tempest-GroupSnapshotsTest-665490019 None] Group tempest-GroupSnapshotsTest-Group-1945009631: creating Jun 24 15:59:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-64d84bed-1202-4650-989f-eb00177f2b6b tempest-GroupSnapshotsTest-665490019 None] Group tempest-GroupSnapshotsTest-Group-1945009631: created successfully Jun 24 15:59:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-64d84bed-1202-4650-989f-eb00177f2b6b tempest-GroupSnapshotsTest-665490019 None] Create group completed successfully. Jun 24 15:59:54 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 15:59:54 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (2f5a5e90-ac7c-4b56-9e33-2e3b860f4995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30bd506-177a-48ed-8d45-4df84a225e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30bd506-177a-48ed-8d45-4df84a225e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T13:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1361816861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a9a373a-5975-4858-8cb0-79cba65f5e9f,host='devstack@QuobyteHD#QuobyteHD',id=37308de1-c62a-497b-b8f2-823aa4ab0503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:55Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96b9415f-072b-47aa-8311-a569b878b9ca),volume_type_id=96b9415f-072b-47aa-8311-a569b878b9ca)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb77e8e-e2c4-42c9-9b9d-13359463e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb77e8e-e2c4-42c9-9b9d-13359463e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e277620d-bd86-485c-aa25-5078754ba51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e277620d-bd86-485c-aa25-5078754ba51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37308de1-c62a-497b-b8f2-823aa4ab0503', 'volume_name': 'volume-37308de1-c62a-497b-b8f2-823aa4ab0503', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdc1117-dc10-468d-823c-7a41e070048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdc1117-dc10-468d-823c-7a41e070048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f23edc5-ae5d-4fc8-a43f-9f4c70df817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:55 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Volume 37308de1-c62a-497b-b8f2-823aa4ab0503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37308de1-c62a-497b-b8f2-823aa4ab0503', 'volume_size': 1} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a9a373a-5975-4858-8cb0-79cba65f5e9f,created_at=2026-06-24T13:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1361816861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a9a373a-5975-4858-8cb0-79cba65f5e9f,host='devstack@QuobyteHD#QuobyteHD',id=37308de1-c62a-497b-b8f2-823aa4ab0503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T13:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T13:59:55Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96b9415f-072b-47aa-8311-a569b878b9ca),volume_type_id=96b9415f-072b-47aa-8311-a569b878b9ca)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Creating volume 37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 15:59:55 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 15:59:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:55 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 1073741824 Jun 24 15:59:55 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:56 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 1073741824" returned: 0 in 1.173s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:56 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 15:59:56 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 15:59:57 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 1.002s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f23edc5-ae5d-4fc8-a43f-9f4c70df817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37308de1-c62a-497b-b8f2-823aa4ab0503', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d472b30c-d2be-4c2c-9a42-9fe156118747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 15:59:57 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Volume volume-37308de1-c62a-497b-b8f2-823aa4ab0503 (37308de1-c62a-497b-b8f2-823aa4ab0503): created successfully Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d472b30c-d2be-4c2c-9a42-9fe156118747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 15:59:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (2f5a5e90-ac7c-4b56-9e33-2e3b860f4995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 15:59:57 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-fcf77ddd-d1fb-4e3a-86ac-43a886eedfae tempest-GroupSnapshotsTest-665490019 None] Created volume successfully. Jun 24 15:59:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] GroupSnapshot fc67451d-2e52-4f62-93e0-fd470c8f187d: creating. Jun 24 15:59:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Group snapshot fc67451d-2e52-4f62-93e0-fd470c8f187d: creating. {{(pid=93867) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 15:59:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 15:59:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 15:59:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Creating offline snapshot e9cd776c-56e6-4f88-ae4a-742f87e0ed52 of volume 37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 15:59:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff6412c-20d0-4472-b424-5e3a89f67a3f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 15:59:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 15:59:59 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 15:59:59 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:00 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 0.841s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:00 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 1G Jun 24 16:00:00 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:00 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 1G" returned: 0 in 0.886s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37308de1-c62a-497b-b8f2-823aa4ab0503 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:01 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37308de1-c62a-497b-b8f2-823aa4ab0503 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 Jun 24 16:00:01 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:01 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37308de1-c62a-497b-b8f2-823aa4ab0503 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52" returned: 0 in 0.839s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:01 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:01 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 Jun 24 16:00:01 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Flow 'volume_create_manager' (22413742-7125-4e85-a908-2aba01b90300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeefec6a-cb9e-4808-a315-1b6dc779215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeefec6a-cb9e-4808-a315-1b6dc779215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1565375349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d127fa3-f850-406a-9571-18f02f8da2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692bd155bf4f428f9b6712342bba8e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:02Z,use_quota=True,user_id='b5906a21253d42e7a86a54b060169b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0dc6ea-0d4b-406e-a168-378c2fb9faed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0dc6ea-0d4b-406e-a168-378c2fb9faed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de42328f-7899-46af-9f52-b3289b4365e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de42328f-7899-46af-9f52-b3289b4365e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d127fa3-f850-406a-9571-18f02f8da2bc', 'volume_name': 'volume-9d127fa3-f850-406a-9571-18f02f8da2bc', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52be17a-58a8-470e-b46b-44fc8baeff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52be17a-58a8-470e-b46b-44fc8baeff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd586441-8eb0-4ea0-af13-a39abe246f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Volume 9d127fa3-f850-406a-9571-18f02f8da2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d127fa3-f850-406a-9571-18f02f8da2bc', 'volume_size': 1} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:02 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52" returned: 0 in 0.911s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:02 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info Jun 24 16:00:02 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:03 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info" returned: 0 in 0.854s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:03 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:03 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info Jun 24 16:00:03 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:04 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.info" returned: 0 in 0.688s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.136s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1565375349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d127fa3-f850-406a-9571-18f02f8da2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692bd155bf4f428f9b6712342bba8e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:02Z,use_quota=True,user_id='b5906a21253d42e7a86a54b060169b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Creating volume 9d127fa3-f850-406a-9571-18f02f8da2bc {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:00:04 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:04 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc 1073741824 Jun 24 16:00:04 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:04 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-396d835a-e725-40e3-9a7e-61875989e94b tempest-GroupSnapshotsTest-665490019 None] group_snapshot fc67451d-2e52-4f62-93e0-fd470c8f187d: created successfully Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Flow 'volume_create_manager' (eef366ec-8f97-48e8-863f-ce6da32b9975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa982b3-76de-435e-be1c-8b9d880879c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa982b3-76de-435e-be1c-8b9d880879c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-264327476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25298d84-2fc6-4f4b-961e-c6acad4f0dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9734feffd1458bb1ef37756ada4fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:05Z,use_quota=True,user_id='a536146212a8430192add3e5ebaaa46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c01dceb-e157-47b1-b4f9-6c107106b240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c01dceb-e157-47b1-b4f9-6c107106b240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0716a5c-d98d-4c51-9dc5-6ba202386fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:04 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:00:05 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc 1073741824" returned: 0 in 0.980s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:05 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc Jun 24 16:00:05 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0716a5c-d98d-4c51-9dc5-6ba202386fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25298d84-2fc6-4f4b-961e-c6acad4f0dfa', 'volume_name': 'volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe10d4d2-21ef-4ece-b6bc-35b406f97e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe10d4d2-21ef-4ece-b6bc-35b406f97e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75002411-1ae2-4c5d-94d4-5289a637a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Volume 25298d84-2fc6-4f4b-961e-c6acad4f0dfa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Trying to clone 25298d84-2fc6-4f4b-961e-c6acad4f0dfa from image cec30253-e3a4-40e1-82d3-11c0f2e0458f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:00:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:00:06 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Image download 20.69 MB at 20.69 MB/s Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0072d4b-1b70-443e-baea-0635a6590fef]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:06 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc" returned: 0 in 0.900s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.411s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-e9cd776c-56e6-4f88-ae4a-742f87e0ed52-371dd139-de7d-4a44-b45f-3bb62ceff995" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:06 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD Jun 24 16:00:06 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd586441-8eb0-4ea0-af13-a39abe246f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d127fa3-f850-406a-9571-18f02f8da2bc', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d13b306-5cc3-4323-ab1f-35f8789a69b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-e9cd776c-56e6-4f88-ae4a-742f87e0ed52-371dd139-de7d-4a44-b45f-3bb62ceff995" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Creating volume 371dd139-de7d-4a44-b45f-3bb62ceff995 from snapshot e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-371dd139-de7d-4a44-b45f-3bb62ceff995" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:06 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Volume volume-9d127fa3-f850-406a-9571-18f02f8da2bc (9d127fa3-f850-406a-9571-18f02f8da2bc): created successfully Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d13b306-5cc3-4323-ab1f-35f8789a69b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Flow 'volume_create_manager' (22413742-7125-4e85-a908-2aba01b90300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-371dd139-de7d-4a44-b45f-3bb62ceff995" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] snapshot: e9cd776c-56e6-4f88-ae4a-742f87e0ed52, volume: 371dd139-de7d-4a44-b45f-3bb62ceff995, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:00:06 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6b5492a0-1f15-47a1-a68a-f70b67e165aa tempest-AttachVolumeNegativeTest-428975072 None] Created volume successfully. Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb640728-62fa-40fe-82b8-7dd1297b2672]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:06 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 Jun 24 16:00:06 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:07 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD" returned: 0 in 0.876s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f is fetched for user a536146212a8430192add3e5ebaaa46b. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17abe7c-172a-4388-a51a-3a3f2c5c686b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:07 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD Jun 24 16:00:07 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:07 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52" returned: 0 in 0.893s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37308de1-c62a-497b-b8f2-823aa4ab0503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ed69f-632e-45c0-8c96-d5b47912a6ac]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:07 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 16:00:07 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:07 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD" returned: 0 in 0.727s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:08 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 0.819s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:08 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:00:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:08 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 Jun 24 16:00:08 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:14 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995" returned: 0 in 6.017s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e806722b-4b3d-4f1c-a8db-c4e047fdd764]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:14 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 16:00:14 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:15 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 1.042s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:15 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:00:15 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Converted 1024.00 MB image at 170.15 MB/s Jun 24 16:00:15 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:15 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 Jun 24 16:00:15 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:15 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995" returned: 0 in 0.730s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-371dd139-de7d-4a44-b45f-3bb62ceff995" released by "_copy_volume_from_snapshot" :: held 9.613s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-e9cd776c-56e6-4f88-ae4a-742f87e0ed52-371dd139-de7d-4a44-b45f-3bb62ceff995" released by "_create_volume_from_snapshot" :: held 9.671s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.718s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.143s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-264327476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25298d84-2fc6-4f4b-961e-c6acad4f0dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e9734feffd1458bb1ef37756ada4fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:05Z,use_quota=True,user_id='a536146212a8430192add3e5ebaaa46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Creating volume 25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:00:16 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:16 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa 1073741824 Jun 24 16:00:16 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2139e7ef-c575-4e9b-b509-b01353226718 tempest-GroupSnapshotsTest-665490019 None] Create group from source-snapshot-fc67451d-2e52-4f62-93e0-fd470c8f187d completed successfully. Jun 24 16:00:16 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa 1073741824" returned: 0 in 0.850s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:16 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:16 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-371dd139-de7d-4a44-b45f-3bb62ceff995" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-371dd139-de7d-4a44-b45f-3bb62ceff995" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29365c7-b2aa-4fe0-b9e9-00ac8084455f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:17 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 Jun 24 16:00:17 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:17 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 0 in 0.698s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.636s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a624bd28-c6de-451e-a185-a2b87de89793]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Attempting download of cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume 25298d84-2fc6-4f4b-961e-c6acad4f0dfa. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a357e46-43a6-4446-b663-897f3102e996]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:17 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc Jun 24 16:00:17 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:17 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5 Jun 24 16:00:17 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:17 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995" returned: 0 in 0.893s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:18 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995 Jun 24 16:00:18 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:18 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc" returned: 0 in 0.822s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-9d127fa3-f850-406a-9571-18f02f8da2bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33f32a2d-1f28-4718-a3e4-8305e8865341', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5" returned: 0 in 0.795s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:18 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-1abe090c-9791-41b4-8ca9-5e4a3e6dcc6c req-1e76b217-1269-4a58-bda5-f5d3511b0634 tempest-AttachVolumeNegativeTest-428975072 None] attachment_update completed successfully. Jun 24 16:00:18 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5 Jun 24 16:00:18 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:18 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-371dd139-de7d-4a44-b45f-3bb62ceff995" returned: 0 in 0.783s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-371dd139-de7d-4a44-b45f-3bb62ceff995" released by "delete_volume" :: held 1.730s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['fbdd043a-b914-4f52-a759-2dd41bab96ab'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:18 devstack cinder-volume[93867]: WARNING cinder.quota [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1551576940 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1551576940, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:00:18 devstack cinder-volume[93867]: WARNING cinder.quota [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1551576940 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1551576940, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:00:18 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['5acf9385-9a8f-4cb5-b1a6-e919429ad622', '70580399-0bf6-423a-9477-6319132b971a', 'c5a91bc6-af25-496e-aa4c-c66920fe3f01', '6cd597dd-8a63-4138-a684-3c1a69961f84'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:19 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:00:19 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:19 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5" returned: 1 in 0.864s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6_k8kk5' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2397665-0019-45df-bff2-b7783b57d00b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] group_snapshot fc67451d-2e52-4f62-93e0-fd470c8f187d: deleting Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] group_snapshot fc67451d-2e52-4f62-93e0-fd470c8f187d: deleting {{(pid=93867) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 16:00:19 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD Jun 24 16:00:19 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-37308de1-c62a-497b-b8f2-823aa4ab0503" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-37308de1-c62a-497b-b8f2-823aa4ab0503" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-e9cd776c-56e6-4f88-ae4a-742f87e0ed52" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-e9cd776c-56e6-4f88-ae4a-742f87e0ed52" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Deleting offline snapshot e9cd776c-56e6-4f88-ae4a-742f87e0ed52 of volume 37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] snapshot_file for this snap is: volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b4c5c-401c-4e53-b464-3d0762490183]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:19 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:19 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:00:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4dadbb0a-ad3b-4911-bba6-2b91d4695072 tempest-GroupSnapshotsTest-665490019 None] Delete group completed successfully. Jun 24 16:00:19 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 Jun 24 16:00:19 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:20 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD" returned: 0 in 0.898s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] cec30253-e3a4-40e1-82d3-11c0f2e0458f was qcow2, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:20 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:20 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:20 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52" returned: 0 in 0.920s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37308de1-c62a-497b-b8f2-823aa4ab0503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb59f6-ec93-4161-8687-fb725e24ba0f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:20 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 16:00:20 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:21 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 1.239s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:21 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 Jun 24 16:00:21 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:22 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52" returned: 0 in 1.062s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:22 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52 Jun 24 16:00:22 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:23 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 0 in 2.748s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:23 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_1etqwo93devstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:00:23 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Converted 112.00 MB image at 40.74 MB/s Jun 24 16:00:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:23 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa 1G Jun 24 16:00:23 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:23 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503.e9cd776c-56e6-4f88-ae4a-742f87e0ed52" returned: 0 in 1.015s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-e9cd776c-56e6-4f88-ae4a-742f87e0ed52" released by "_delete_snapshot" :: held 4.374s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-37308de1-c62a-497b-b8f2-823aa4ab0503" released by "delete_snapshot" :: held 4.417s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:24 devstack cinder-volume[93867]: WARNING cinder.quota [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1551576940 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1551576940, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:00:24 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['13109890-497d-40ee-ab3c-b4a49a815ec4', '16dda9d3-2088-4c49-b76a-8ab5176dd374', 'a4c86583-e4d0-45c3-bba3-2f2d58b9cb00', 'db68a1cb-9fc3-4cec-a003-b07b14555935'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-65581163-18f8-48f8-9fa3-32830704b473 tempest-GroupSnapshotsTest-665490019 None] group_snapshot fc67451d-2e52-4f62-93e0-fd470c8f187d: deleted successfully Jun 24 16:00:24 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa 1G" returned: 0 in 1.249s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a83b3f-c309-4c75-a345-a47d06edaaac]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:24 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:24 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:25 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 0 in 1.187s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-37308de1-c62a-497b-b8f2-823aa4ab0503" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-37308de1-c62a-497b-b8f2-823aa4ab0503" acquired by "delete_volume" :: waited 0.052s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:25 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:25 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a66774-5c15-4f3e-8222-35677e53c7ee]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:26 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 16:00:26 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:26 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 1 in 1.326s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Downloaded image cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume 25298d84-2fc6-4f4b-961e-c6acad4f0dfa successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f for user a536146212a8430192add3e5ebaaa46b is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Marking volume 25298d84-2fc6-4f4b-961e-c6acad4f0dfa as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Copying metadata from image cec30253-e3a4-40e1-82d3-11c0f2e0458f to 25298d84-2fc6-4f4b-961e-c6acad4f0dfa. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:00:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Creating volume glance metadata for volume 25298d84-2fc6-4f4b-961e-c6acad4f0dfa backed by image cec30253-e3a4-40e1-82d3-11c0f2e0458f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:00:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75002411-1ae2-4c5d-94d4-5289a637a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8279480-ca3f-4a45-971b-313d2cdb36be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Volume volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa (25298d84-2fc6-4f4b-961e-c6acad4f0dfa): created successfully Jun 24 16:00:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8279480-ca3f-4a45-971b-313d2cdb36be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Flow 'volume_create_manager' (eef366ec-8f97-48e8-863f-ce6da32b9975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:27 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7df9ef0e-901a-4623-a969-5c4656b1086d tempest-VolumesImageMetadata-557743842 None] Created volume successfully. Jun 24 16:00:27 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 1.379s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:27 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503 Jun 24 16:00:27 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:28 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-37308de1-c62a-497b-b8f2-823aa4ab0503" returned: 0 in 1.024s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-37308de1-c62a-497b-b8f2-823aa4ab0503" released by "delete_volume" :: held 2.519s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['92d7bcc3-a8a7-4965-b2ba-b0f459db2aaa'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Acquiring lock "cinder-25298d84-2fc6-4f4b-961e-c6acad4f0dfa-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Lock "cinder-25298d84-2fc6-4f4b-961e-c6acad4f0dfa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Acquiring lock "cinder-quobyte-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:28 devstack cinder-volume[93867]: WARNING cinder.db.api [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1551576940'] Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['378083b5-13fa-4c09-8d49-e5a1c0d59954', '1ab7cebe-ea12-447d-a3c1-06c24d296336', '5ca32d3b-5744-409c-a9e1-f2614a1bb5a7', 'a7118dce-bae5-48c2-819b-1bb8bc60d1e5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Lock "cinder-quobyte-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[46767a15-39e0-44e3-9312-1f08c0b21d90]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:28 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:00:28 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:28 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:28 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:29 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 0 in 1.108s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:29 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.059s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:29 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:00:29 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-aee02014-fd0f-4ab4-854e-15de44f5d3b2 tempest-GroupSnapshotsTest-665490019 None] Delete group completed successfully. Jun 24 16:00:29 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:29 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f82aea7-3052-4791-b7f9-3910ba877f4f tempest-GroupSnapshotsTest-665490019 None] Group tempest-GroupSnapshotsTest-Group-2080730155: creating Jun 24 16:00:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f82aea7-3052-4791-b7f9-3910ba877f4f tempest-GroupSnapshotsTest-665490019 None] Group tempest-GroupSnapshotsTest-Group-2080730155: created successfully Jun 24 16:00:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f82aea7-3052-4791-b7f9-3910ba877f4f tempest-GroupSnapshotsTest-665490019 None] Create group completed successfully. Jun 24 16:00:30 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 1 in 0.887s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:00:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:30 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa Jun 24 16:00:30 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:31 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Lock "cinder-quobyte-25298d84-2fc6-4f4b-961e-c6acad4f0dfa" released by "delete_volume" :: held 2.771s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Created reservations ['aa094a68-7bf0-4a95-bc6b-02c842cf31db', 'eec5345d-65a1-4362-af4f-f2cb7a9c1186', '281c295d-02d4-4169-8594-ce4ac8761f66', '9301c0f1-c630-44f3-8ed1-62b5e4c96d9b'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:31 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:00:31 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (19ee5318-7dbd-40c5-ad02-68015273d8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152ac962-26d6-4883-b108-be75e3ea5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152ac962-26d6-4883-b108-be75e3ea5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-386497076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af61625a-5cdd-48f2-8d0d-01b408977883,host='devstack@QuobyteHD#QuobyteHD',id=0aa4b5ad-e002-4409-b8c3-b347e672f6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:32Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef),volume_type_id=1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a712010-a62d-4e2d-9d0b-78672f400c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a712010-a62d-4e2d-9d0b-78672f400c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bee0abb-0a79-462a-b80f-46fbb363a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bee0abb-0a79-462a-b80f-46fbb363a650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa4b5ad-e002-4409-b8c3-b347e672f6c3', 'volume_name': 'volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4e5465-347e-4754-a279-bb488dddb329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4e5465-347e-4754-a279-bb488dddb329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62230b0d-cc06-47d3-82ac-749aafed7727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:32 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Volume 0aa4b5ad-e002-4409-b8c3-b347e672f6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3', 'volume_size': 1} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af61625a-5cdd-48f2-8d0d-01b408977883,created_at=2026-06-24T14:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-386497076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af61625a-5cdd-48f2-8d0d-01b408977883,host='devstack@QuobyteHD#QuobyteHD',id=0aa4b5ad-e002-4409-b8c3-b347e672f6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:32Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef),volume_type_id=1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Creating volume 0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:00:32 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:00:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:32 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 1073741824 Jun 24 16:00:32 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:33 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.815s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:33 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:00:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Deleted volume successfully. Jun 24 16:00:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0512945c-129b-4a25-b2f2-911606e775ed tempest-VolumesImageMetadata-557743842 None] Lock "cinder-25298d84-2fc6-4f4b-961e-c6acad4f0dfa-delete_volume" released by "delete_volume" :: held 4.902s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:33 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 1073741824" returned: 0 in 1.700s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:34 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 Jun 24 16:00:34 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:35 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" returned: 0 in 1.292s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] <== create_volume: return (3099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.102s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=96,cinder:DELETE=7,cinder:SELECT=73,cinder:INSERT=34 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62230b0d-cc06-47d3-82ac-749aafed7727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f0d54b-b1ed-4bde-9f5d-2b9d66470d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=81,cinder:SELECT=99,cinder:INSERT=19,cinder:DELETE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:00:35 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Volume volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 (0aa4b5ad-e002-4409-b8c3-b347e672f6c3): created successfully Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f0d54b-b1ed-4bde-9f5d-2b9d66470d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (19ee5318-7dbd-40c5-ad02-68015273d8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6dce9867-a8fe-419d-b790-275f303a5b0a tempest-GroupSnapshotsTest-665490019 None] Created volume successfully. Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (26f1265a-f1f8-4fc8-94c6-8cc9fee118dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec6963d-60d1-4718-a92d-8ae1e0c15683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec6963d-60d1-4718-a92d-8ae1e0c15683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1593610319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af61625a-5cdd-48f2-8d0d-01b408977883,host='devstack@QuobyteHD#QuobyteHD',id=39f7be9a-fdba-400c-bf19-bd046b3c8d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:37Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef),volume_type_id=1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf108a9c-17ba-4c9d-863e-a2178217fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf108a9c-17ba-4c9d-863e-a2178217fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33baba5-d723-4677-ac9d-ca29f1ce71fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33baba5-d723-4677-ac9d-ca29f1ce71fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f7be9a-fdba-400c-bf19-bd046b3c8d85', 'volume_name': 'volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a332653-62c2-4a97-81af-4cc182a3920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a332653-62c2-4a97-81af-4cc182a3920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6967bbbb-e4fa-4a27-b7c5-d3f34e08504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Volume 39f7be9a-fdba-400c-bf19-bd046b3c8d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85', 'volume_size': 1} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=af61625a-5cdd-48f2-8d0d-01b408977883,created_at=2026-06-24T14:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1593610319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=af61625a-5cdd-48f2-8d0d-01b408977883,host='devstack@QuobyteHD#QuobyteHD',id=39f7be9a-fdba-400c-bf19-bd046b3c8d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:37Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef),volume_type_id=1f5b80fe-d2a4-4af0-aa7b-8a8944a54bef)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Creating volume 39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:00:37 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:37 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 1073741824 Jun 24 16:00:37 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Flow 'volume_create_manager' (43b404f1-f3a7-485d-9d23-c8cdfb19d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423765cd-a005-4d84-bafe-66c5a2cd2159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423765cd-a005-4d84-bafe-66c5a2cd2159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-76879100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6079da01-03bd-4084-a5ba-341abc499f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed5ad2620746f4b580bc8493f07013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:38Z,use_quota=True,user_id='c6ecf1edbb6341a6bd8d9fdba290b07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fad4e93-8af9-4d79-af57-09178704c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fad4e93-8af9-4d79-af57-09178704c33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac1740c-a8cd-4976-ac7a-373dd9637eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac1740c-a8cd-4976-ac7a-373dd9637eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6079da01-03bd-4084-a5ba-341abc499f73', 'volume_name': 'volume-6079da01-03bd-4084-a5ba-341abc499f73', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b30b64-e616-4d11-b629-86c17c684642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b30b64-e616-4d11-b629-86c17c684642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ef8332-8cd1-47c3-89cb-daee46a9447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Volume 6079da01-03bd-4084-a5ba-341abc499f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6079da01-03bd-4084-a5ba-341abc499f73', 'volume_size': 1} Jun 24 16:00:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:38 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 1073741824" returned: 0 in 1.094s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:38 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 Jun 24 16:00:38 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:39 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:00:39 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:39 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85" returned: 0 in 0.745s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-76879100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6079da01-03bd-4084-a5ba-341abc499f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed5ad2620746f4b580bc8493f07013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:38Z,use_quota=True,user_id='c6ecf1edbb6341a6bd8d9fdba290b07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Creating volume 6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:00:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6967bbbb-e4fa-4a27-b7c5-d3f34e08504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:39 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 1073741824 Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba25a7e-1f8c-4d5a-b3dc-e0128403ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:39 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Volume volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 (39f7be9a-fdba-400c-bf19-bd046b3c8d85): created successfully Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba25a7e-1f8c-4d5a-b3dc-e0128403ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (26f1265a-f1f8-4fc8-94c6-8cc9fee118dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-71d8d609-d8b7-4926-bcd6-94da1806504c tempest-GroupSnapshotsTest-665490019 None] Created volume successfully. Jun 24 16:00:39 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.745s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:00:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:00:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-242b7cc0-6483-4a03-b2b6-5038c3200a05 tempest-GroupSnapshotsTest-665490019 None] Update group completed successfully. Jun 24 16:00:40 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 1073741824" returned: 0 in 0.877s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:40 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 Jun 24 16:00:40 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:41 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73" returned: 0 in 0.747s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ef8332-8cd1-47c3-89cb-daee46a9447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6079da01-03bd-4084-a5ba-341abc499f73', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c51fd3-e71e-44fb-9c47-44563506e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:41 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Volume volume-6079da01-03bd-4084-a5ba-341abc499f73 (6079da01-03bd-4084-a5ba-341abc499f73): created successfully Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c51fd3-e71e-44fb-9c47-44563506e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Flow 'volume_create_manager' (43b404f1-f3a7-485d-9d23-c8cdfb19d827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c25751d2-34ce-4a7b-90c0-0d01ea968234 tempest-SnapshotMetadataTestJSON-434056947 None] Created volume successfully. Jun 24 16:00:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4cb0c136-f1a5-44b6-a13d-9db10bf3c046 tempest-GroupSnapshotsTest-665490019 None] Update group completed successfully. Jun 24 16:00:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Creating offline snapshot 2f64ed49-b911-4eeb-9509-51e9ae9ee4aa of volume 6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:00:42 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b55cda5-f2db-42eb-967b-307635f7ed9a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:42 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 Jun 24 16:00:42 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c3090b2f-f22e-4391-a204-8aa1aace8f8c tempest-GroupSnapshotsTest-665490019 None] Update group completed successfully. Jun 24 16:00:43 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73" returned: 0 in 1.119s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:43 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa 1G Jun 24 16:00:43 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7bc7d297-3317-4b0b-9cb4-bcc19f5b449f tempest-GroupSnapshotsTest-665490019 None] Update group completed successfully. Jun 24 16:00:44 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa 1G" returned: 0 in 1.625s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6079da01-03bd-4084-a5ba-341abc499f73 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:44 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6079da01-03bd-4084-a5ba-341abc499f73 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa Jun 24 16:00:44 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] GroupSnapshot 0330253a-91ba-4fec-9bbe-73a2cb54e02b: creating. Jun 24 16:00:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Group snapshot 0330253a-91ba-4fec-9bbe-73a2cb54e02b: creating. {{(pid=93867) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 16:00:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:46 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6079da01-03bd-4084-a5ba-341abc499f73 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" returned: 0 in 1.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:46 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa is being set with open permissions: ugo+rw Jun 24 16:00:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:46 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa Jun 24 16:00:46 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:47 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" returned: 0 in 1.054s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:47 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info Jun 24 16:00:47 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:48 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info" returned: 0 in 1.106s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:48 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info is being set with open permissions: ugo+rw Jun 24 16:00:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:48 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info Jun 24 16:00:48 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:49 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.info" returned: 0 in 1.013s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.736s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.636s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Creating offline snapshot 71384d0e-fe12-4cc9-9cd6-c2b8794338fb of volume 39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:00:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c39541ec-bf1d-4093-bac3-fffb63b3c3b5 tempest-SnapshotMetadataTestJSON-434056947 None] Create snapshot completed successfully Jun 24 16:00:49 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27da184-53cd-4cda-b459-b915a6c98394]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:50 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 Jun 24 16:00:50 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:51 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85" returned: 0 in 1.208s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:51 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb 1G Jun 24 16:00:51 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "cinder-2f64ed49-b911-4eeb-9509-51e9ae9ee4aa-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-2f64ed49-b911-4eeb-9509-51e9ae9ee4aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "cinder-quobyte-6079da01-03bd-4084-a5ba-341abc499f73" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-quobyte-6079da01-03bd-4084-a5ba-341abc499f73" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "cinder-quobyte-2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-quobyte-2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Deleting offline snapshot 2f64ed49-b911-4eeb-9509-51e9ae9ee4aa of volume 6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] snapshot_file for this snap is: volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e63b17-ab8b-4776-a59c-ccc685b89ec6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:52 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa Jun 24 16:00:52 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:52 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb 1G" returned: 0 in 1.148s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:52 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb Jun 24 16:00:52 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:52 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" returned: 0 in 1.064s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6079da01-03bd-4084-a5ba-341abc499f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf709c-cee3-41f4-a5ad-52a0da1de335]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:53 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb" returned: 0 in 0.946s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:53 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:53 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 Jun 24 16:00:53 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:53 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb Jun 24 16:00:53 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:53 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:53 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb" returned: 0 in 0.725s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73" returned: 0 in 0.855s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:53 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa Jun 24 16:00:53 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:53 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info Jun 24 16:00:53 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:54 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info" returned: 0 in 0.792s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:54 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:54 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info Jun 24 16:00:54 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:54 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" returned: 0 in 0.911s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:54 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa Jun 24 16:00:54 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Flow 'volume_create_manager' (87177efe-908a-4f60-a0b9-7184f624e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf73de1-faf6-46f8-9fe7-70062784d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf73de1-faf6-46f8-9fe7-70062784d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-663413770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e3f37-0394-4623-9b58-ffe65d54003a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099befe230f844fd93b309d77cc1f89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:55Z,use_quota=True,user_id='ed0871d5885d44c7b20e07a95d4b0b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70df07e0-fe62-4005-9e33-75951dce5820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70df07e0-fe62-4005-9e33-75951dce5820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc8080e-c2f1-45c7-b1e6-8b520fc962db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc8080e-c2f1-45c7-b1e6-8b520fc962db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5e3f37-0394-4623-9b58-ffe65d54003a', 'volume_name': 'volume-4c5e3f37-0394-4623-9b58-ffe65d54003a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad5505f-26d4-4e51-ade9-5cfe8575b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad5505f-26d4-4e51-ade9-5cfe8575b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cf541c-b425-41d8-a05c-06ac6fc4a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:00:55 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Volume 4c5e3f37-0394-4623-9b58-ffe65d54003a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5e3f37-0394-4623-9b58-ffe65d54003a', 'volume_size': 1} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:55 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73.2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" returned: 0 in 0.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:55 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-quobyte-2f64ed49-b911-4eeb-9509-51e9ae9ee4aa" released by "_delete_snapshot" :: held 3.763s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.info" returned: 0 in 0.918s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.904s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-quobyte-6079da01-03bd-4084-a5ba-341abc499f73" released by "delete_snapshot" :: held 3.819s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Creating offline snapshot 96cb1121-1b8c-46ad-b1f0-4f884dee9786 of volume 0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659dfd3-8b66-4282-b9dd-d5d3120217ed]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Created reservations ['ddf7fb51-ab42-4772-98fd-00fa272f0b6f', 'e2773ac3-766f-45fc-92ce-f39416150a26', '477d49fc-b140-45ad-9442-d0d026c547e6', '49339100-da33-40f2-93fe-32e21110f774'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Delete snapshot completed successfully. Jun 24 16:00:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3c3092cc-0f44-43fa-befe-64e595905f03 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-2f64ed49-b911-4eeb-9509-51e9ae9ee4aa-delete_snapshot" released by "delete_snapshot" :: held 4.002s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:55 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 Jun 24 16:00:55 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "cinder-6079da01-03bd-4084-a5ba-341abc499f73-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-6079da01-03bd-4084-a5ba-341abc499f73-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "cinder-quobyte-6079da01-03bd-4084-a5ba-341abc499f73" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-quobyte-6079da01-03bd-4084-a5ba-341abc499f73" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd979a9-1269-47f1-b8bb-fa79fcc228e3]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:56 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" returned: 0 in 0.869s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:56 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 1G Jun 24 16:00:56 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:56 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 Jun 24 16:00:56 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:57 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73" returned: 0 in 0.775s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:57 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73 Jun 24 16:00:57 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:57 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 1G" returned: 0 in 0.829s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:57 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 Jun 24 16:00:57 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:58 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6079da01-03bd-4084-a5ba-341abc499f73" returned: 0 in 0.738s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-quobyte-6079da01-03bd-4084-a5ba-341abc499f73" released by "delete_volume" :: held 1.573s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Created reservations ['b8624ce4-8cc1-4fa4-b8e7-73443e193b11', '65b7dff5-b104-4576-a30c-4827e4df8db6', 'c5cdb35c-edca-4c97-9c39-666334d3b378', 'fac8682b-e346-4ce7-a580-bf069adba456'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:00:58 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:58 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:58 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 Jun 24 16:00:58 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:00:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:58 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:00:58 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:59 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786" returned: 0 in 0.846s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:59 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info Jun 24 16:00:59 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:00:59 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.929s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:00:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Deleted volume successfully. Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-41a1bf19-3620-4b5e-945b-1c8f328af0d5 tempest-SnapshotMetadataTestJSON-434056947 None] Lock "cinder-6079da01-03bd-4084-a5ba-341abc499f73-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:00:59 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:00:59 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:00:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:00:59 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info Jun 24 16:00:59 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:00 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.info" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.920s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.071s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-663413770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e3f37-0394-4623-9b58-ffe65d54003a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099befe230f844fd93b309d77cc1f89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:00:55Z,use_quota=True,user_id='ed0871d5885d44c7b20e07a95d4b0b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Creating volume 4c5e3f37-0394-4623-9b58-ffe65d54003a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:00 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:00 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a 1073741824 Jun 24 16:01:00 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:00 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d1d25b12-1dc9-409e-874a-e6eea7f72b11 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0330253a-91ba-4fec-9bbe-73a2cb54e02b: created successfully Jun 24 16:01:01 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0330253a-91ba-4fec-9bbe-73a2cb54e02b: deleting Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0330253a-91ba-4fec-9bbe-73a2cb54e02b: deleting {{(pid=93867) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-39f7be9a-fdba-400c-bf19-bd046b3c8d85" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-39f7be9a-fdba-400c-bf19-bd046b3c8d85" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-71384d0e-fe12-4cc9-9cd6-c2b8794338fb" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-71384d0e-fe12-4cc9-9cd6-c2b8794338fb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Deleting offline snapshot 71384d0e-fe12-4cc9-9cd6-c2b8794338fb of volume 39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] snapshot_file for this snap is: volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ecc0b-2530-4fcf-ab5c-e2e3bc5e5b8f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:01 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb Jun 24 16:01:01 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:01 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a 1073741824" returned: 0 in 0.971s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:01 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a Jun 24 16:01:01 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:02 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb" returned: 0 in 0.849s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ff85e-0467-4527-acda-c4b1244ad859]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:02 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 Jun 24 16:01:02 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:02 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a" returned: 0 in 0.670s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cf541c-b425-41d8-a05c-06ac6fc4a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5e3f37-0394-4623-9b58-ffe65d54003a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb4a75d-a7c4-4f3d-9a2d-fde74b57c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Volume volume-4c5e3f37-0394-4623-9b58-ffe65d54003a (4c5e3f37-0394-4623-9b58-ffe65d54003a): created successfully Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb4a75d-a7c4-4f3d-9a2d-fde74b57c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Flow 'volume_create_manager' (87177efe-908a-4f60-a0b9-7184f624e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9a75da14-4828-4416-b7ad-a81bc377595a tempest-ServersNegativeTestJSON-402474199 None] Created volume successfully. Jun 24 16:01:02 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85" returned: 0 in 0.826s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:03 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb Jun 24 16:01:03 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Flow 'volume_create_manager' (107221cd-e348-449e-9401-6311399b6e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619afa3b-a2fa-47b1-aa1b-b2511a04693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619afa3b-a2fa-47b1-aa1b-b2511a04693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1860289183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5be2621-122f-4078-8b9e-46da5dedb422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b01c03cfc6444c8861b57ae2399539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:04Z,use_quota=True,user_id='449df0d6800945639ceddd9bbb956c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37249327-4801-4e4b-9902-9ee39bca0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37249327-4801-4e4b-9902-9ee39bca0075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab86b69-7efc-42e0-a985-aa9857f43d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab86b69-7efc-42e0-a985-aa9857f43d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5be2621-122f-4078-8b9e-46da5dedb422', 'volume_name': 'volume-b5be2621-122f-4078-8b9e-46da5dedb422', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59e3590-56b3-4b6f-b740-25ab9e38efd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59e3590-56b3-4b6f-b740-25ab9e38efd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb8608f-1676-4b00-91fb-b75f5e4526e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:03 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Volume b5be2621-122f-4078-8b9e-46da5dedb422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5be2621-122f-4078-8b9e-46da5dedb422', 'volume_size': 1} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1860289183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5be2621-122f-4078-8b9e-46da5dedb422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b01c03cfc6444c8861b57ae2399539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:04Z,use_quota=True,user_id='449df0d6800945639ceddd9bbb956c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Creating volume b5be2621-122f-4078-8b9e-46da5dedb422 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:03 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:03 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 1073741824 Jun 24 16:01:03 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:03 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb" returned: 0 in 0.826s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:03 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb Jun 24 16:01:03 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Flow 'volume_create_manager' (a8db4aa1-0832-482c-a3b3-99146ee8961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a1a69-bfbe-482f-86f6-69bf4eeb2be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a1a69-bfbe-482f-86f6-69bf4eeb2be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-955438710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32efb05d-620b-42c4-8017-203bcc8add80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099befe230f844fd93b309d77cc1f89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:04Z,use_quota=True,user_id='ed0871d5885d44c7b20e07a95d4b0b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce423910-6c73-4854-b903-5ac8318aa016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce423910-6c73-4854-b903-5ac8318aa016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa10be9a-88e8-4109-a292-456a6216aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa10be9a-88e8-4109-a292-456a6216aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32efb05d-620b-42c4-8017-203bcc8add80', 'volume_name': 'volume-32efb05d-620b-42c4-8017-203bcc8add80', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5879e80d-a687-4134-b323-f70626327727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5879e80d-a687-4134-b323-f70626327727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98637940-f070-4f60-8de7-ee9be7d6ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Volume 32efb05d-620b-42c4-8017-203bcc8add80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32efb05d-620b-42c4-8017-203bcc8add80', 'volume_size': 1} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:04 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85.71384d0e-fe12-4cc9-9cd6-c2b8794338fb" returned: 0 in 0.721s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-71384d0e-fe12-4cc9-9cd6-c2b8794338fb" released by "_delete_snapshot" :: held 3.344s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-39f7be9a-fdba-400c-bf19-bd046b3c8d85" released by "delete_snapshot" :: held 3.376s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-96cb1121-1b8c-46ad-b1f0-4f884dee9786" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:04 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-96cb1121-1b8c-46ad-b1f0-4f884dee9786" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Deleting offline snapshot 96cb1121-1b8c-46ad-b1f0-4f884dee9786 of volume 0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] snapshot_file for this snap is: volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 1073741824" returned: 0 in 0.954s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[75acd081-936d-4e40-bc53-0af1c41603ea]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:04 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 Jun 24 16:01:04 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:04 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 Jun 24 16:01:04 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:05 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422" returned: 0 in 0.708s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-955438710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32efb05d-620b-42c4-8017-203bcc8add80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='099befe230f844fd93b309d77cc1f89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:04Z,use_quota=True,user_id='ed0871d5885d44c7b20e07a95d4b0b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Creating volume 32efb05d-620b-42c4-8017-203bcc8add80 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:05 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb8608f-1676-4b00-91fb-b75f5e4526e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5be2621-122f-4078-8b9e-46da5dedb422', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:05 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 1073741824 Jun 24 16:01:05 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e21253b-b1e7-4ddf-8e9f-a8a7385eab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Volume volume-b5be2621-122f-4078-8b9e-46da5dedb422 (b5be2621-122f-4078-8b9e-46da5dedb422): created successfully Jun 24 16:01:05 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e21253b-b1e7-4ddf-8e9f-a8a7385eab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Flow 'volume_create_manager' (107221cd-e348-449e-9401-6311399b6e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786" returned: 0 in 0.851s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:01:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bdfb8335-99e3-4e59-85b5-43d2952c5b2c tempest-VolumesTransfersV355Test-217761548 None] Created volume successfully. Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f7b9f9-de3a-43be-86ac-c0ae17f852d9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:05 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 Jun 24 16:01:05 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:06 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 1073741824" returned: 0 in 1.287s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:06 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-026aa8ed-b253-4848-82ea-b5ef48ebfe24 tempest-VolumesTransfersV355Test-1114676727 None] Transfer volume completed successfully. Jun 24 16:01:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:06 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" returned: 0 in 1.219s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:06 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 Jun 24 16:01:06 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:06 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 Jun 24 16:01:06 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:07 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80" returned: 0 in 0.690s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98637940-f070-4f60-8de7-ee9be7d6ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32efb05d-620b-42c4-8017-203bcc8add80', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7219e72-f8d3-429e-97c6-685c5748126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Volume volume-32efb05d-620b-42c4-8017-203bcc8add80 (32efb05d-620b-42c4-8017-203bcc8add80): created successfully Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7219e72-f8d3-429e-97c6-685c5748126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Flow 'volume_create_manager' (a8db4aa1-0832-482c-a3b3-99146ee8961d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a33d79f4-cc99-448e-97bf-61919c6eefb2 tempest-ServersNegativeTestJSON-402474199 None] Created volume successfully. Jun 24 16:01:07 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786" returned: 0 in 0.804s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:07 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786 Jun 24 16:01:07 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Acquiring lock "cinder-b5be2621-122f-4078-8b9e-46da5dedb422-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-b5be2621-122f-4078-8b9e-46da5dedb422-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Acquiring lock "cinder-quobyte-b5be2621-122f-4078-8b9e-46da5dedb422" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-quobyte-b5be2621-122f-4078-8b9e-46da5dedb422" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f6ea74-bbec-497b-9483-2d0f5a3d0faf]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:07 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 Jun 24 16:01:07 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:08 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3.96cb1121-1b8c-46ad-b1f0-4f884dee9786" returned: 0 in 0.675s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-96cb1121-1b8c-46ad-b1f0-4f884dee9786" released by "_delete_snapshot" :: held 3.674s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" released by "delete_snapshot" :: held 3.701s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:08 devstack cinder-volume[93867]: WARNING cinder.quota [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-260398534 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-260398534, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:01:08 devstack cinder-volume[93867]: WARNING cinder.quota [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-260398534 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-260398534, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['49fb6953-2081-427d-be7e-1d4607b83a56', 'd3fde5b2-6f7d-432f-a201-22f8ca58b875', 'c40f8e17-cbe7-4ec3-94e0-a456644cc970', 'bcf96941-11ca-40d3-84b2-adbf8ed1af61'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['fa3711dc-2766-4765-b0c1-6cfa5ed23504', 'de2a0515-6d4b-42c1-bc6c-af3c5f168a5b', 'cc709fb1-8fc7-4042-8de8-8ec6ef5b7fbc', '231723a0-eae2-459a-b7ae-7cfe49aff283'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0cdd9365-a311-4f86-b5b8-8dcaa22295d4 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0330253a-91ba-4fec-9bbe-73a2cb54e02b: deleted successfully Jun 24 16:01:08 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422" returned: 0 in 0.781s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:08 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422 Jun 24 16:01:08 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "cinder-32efb05d-620b-42c4-8017-203bcc8add80-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-32efb05d-620b-42c4-8017-203bcc8add80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "cinder-quobyte-32efb05d-620b-42c4-8017-203bcc8add80" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-quobyte-32efb05d-620b-42c4-8017-203bcc8add80" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37dc4de-d6e8-49d7-8636-0abe29db3807]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:09 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 Jun 24 16:01:09 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:09 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5be2621-122f-4078-8b9e-46da5dedb422" returned: 0 in 0.738s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" acquired by "delete_volume" :: waited 0.032s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-quobyte-b5be2621-122f-4078-8b9e-46da5dedb422" released by "delete_volume" :: held 1.591s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81065c-77e2-4b37-bc5e-2d42c81c018c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Created reservations ['3451f16a-33c9-4035-947b-0d1f9b0facf4', '333c4e3e-11a2-4e65-8fa9-4461bf20f904', '2e983b6a-33b1-48f7-a023-fa85f608ffee', 'b4129851-8648-4681-8cea-84772bbf6b98'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:09 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 Jun 24 16:01:09 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:09 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:09 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:10 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80" returned: 0 in 0.860s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:10 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80 Jun 24 16:01:10 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:10 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:10 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" returned: 0 in 0.895s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:10 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Deleted volume successfully. Jun 24 16:01:10 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3 Jun 24 16:01:10 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-51d69dbf-2171-4769-910f-b84fc00aef7c tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-b5be2621-122f-4078-8b9e-46da5dedb422-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Flow 'volume_create_manager' (2a8b6f15-e564-47df-bd09-2e14ab02a087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75155d98-0909-4987-b3b9-8ac109adfab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75155d98-0909-4987-b3b9-8ac109adfab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-562257572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1b3e90-8685-463d-af3b-02e0d25b9731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b01c03cfc6444c8861b57ae2399539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:11Z,use_quota=True,user_id='449df0d6800945639ceddd9bbb956c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3377102-60bd-4c17-9701-37e9608c39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3377102-60bd-4c17-9701-37e9608c39d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23f7e03-4d7a-4479-a58a-d63fab8aacc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23f7e03-4d7a-4479-a58a-d63fab8aacc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1b3e90-8685-463d-af3b-02e0d25b9731', 'volume_name': 'volume-2c1b3e90-8685-463d-af3b-02e0d25b9731', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4150c1da-63f8-4f96-a720-e7595bb106de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4150c1da-63f8-4f96-a720-e7595bb106de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1e88de-0ef0-4c60-ab6f-81a077b0078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:10 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Volume 2c1b3e90-8685-463d-af3b-02e0d25b9731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1b3e90-8685-463d-af3b-02e0d25b9731', 'volume_size': 1} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-562257572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1b3e90-8685-463d-af3b-02e0d25b9731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b01c03cfc6444c8861b57ae2399539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:11Z,use_quota=True,user_id='449df0d6800945639ceddd9bbb956c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Creating volume 2c1b3e90-8685-463d-af3b-02e0d25b9731 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:10 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:10 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 1073741824 Jun 24 16:01:10 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:10 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-32efb05d-620b-42c4-8017-203bcc8add80" returned: 0 in 0.746s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-quobyte-32efb05d-620b-42c4-8017-203bcc8add80" released by "delete_volume" :: held 1.654s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Created reservations ['6aee8caf-93af-46c3-9185-4a7f90b44b80', '1ccb3f56-7572-4c4e-98dd-fd29fd1adfa7', '4c4413a9-4540-4884-ac31-296aafa2c67d', 'a32a5a2a-bf40-48c0-b661-7a9782fb5dd4'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:10 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:10 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:11 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" returned: 0 in 0.739s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-0aa4b5ad-e002-4409-b8c3-b347e672f6c3" released by "delete_volume" :: held 1.706s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-39f7be9a-fdba-400c-bf19-bd046b3c8d85" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-39f7be9a-fdba-400c-bf19-bd046b3c8d85" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da4cc8a-6f1b-4315-8ca2-4771878cb99c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:11 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 Jun 24 16:01:11 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "cinder-4c5e3f37-0394-4623-9b58-ffe65d54003a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-4c5e3f37-0394-4623-9b58-ffe65d54003a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "cinder-quobyte-4c5e3f37-0394-4623-9b58-ffe65d54003a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-quobyte-4c5e3f37-0394-4623-9b58-ffe65d54003a" acquired by "delete_volume" :: waited 0.058s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bafcb2-e319-41df-9e19-d7c2fa1d3d88]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:11 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a Jun 24 16:01:11 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:11 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.827s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:11 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Deleted volume successfully. Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2467712e-171b-4751-a8a3-7c9a5b37ba51 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-32efb05d-620b-42c4-8017-203bcc8add80-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:11 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 1073741824" returned: 0 in 1.156s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:12 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 Jun 24 16:01:12 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:12 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85" returned: 0 in 1.083s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:12 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85 Jun 24 16:01:12 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:12 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a" returned: 0 in 0.842s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:12 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a Jun 24 16:01:12 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:12 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731" returned: 0 in 0.814s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1e88de-0ef0-4c60-ab6f-81a077b0078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1b3e90-8685-463d-af3b-02e0d25b9731', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60b9b6f-ea06-4797-bdcf-12942a8039b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Volume volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 (2c1b3e90-8685-463d-af3b-02e0d25b9731): created successfully Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60b9b6f-ea06-4797-bdcf-12942a8039b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Flow 'volume_create_manager' (2a8b6f15-e564-47df-bd09-2e14ab02a087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:12 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-985e489b-fefb-42ef-9a8b-cd676922e1d8 tempest-VolumesTransfersV355Test-217761548 None] Created volume successfully. Jun 24 16:01:12 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-39f7be9a-fdba-400c-bf19-bd046b3c8d85" returned: 0 in 0.724s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-39f7be9a-fdba-400c-bf19-bd046b3c8d85" released by "delete_volume" :: held 1.862s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Created reservations ['bd9d9a62-869e-42c3-8045-014055488f63'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:13 devstack cinder-volume[93867]: WARNING cinder.quota [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-260398534 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-260398534, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Created reservations ['ca7f8697-8f3b-466a-8716-9bde132c31c0', 'ca681040-ba34-4f64-8261-8d23be88c7ab', 'e2acdb28-d9f6-4586-b8b1-ef87eea98c06', '31313153-b7b8-4dc3-8cd5-cd25be92beef'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Created reservations ['743c15ef-7b88-4cdd-b309-d023bd6b12a6', '28c4b19c-2224-4879-a9e8-a6cd0a50ea34', '5be31e8a-4e1b-4640-95a6-a0ce9428963f', '43023b01-05a6-4670-9d4d-a531e85f5337'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:13 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4c5e3f37-0394-4623-9b58-ffe65d54003a" returned: 0 in 0.981s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-quobyte-4c5e3f37-0394-4623-9b58-ffe65d54003a" released by "delete_volume" :: held 1.900s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Created reservations ['f029e8f7-6899-4515-bde7-9c59cf9325b5', 'e78ec1ad-3589-4aac-8347-6603e2279a8b', '2ae932a2-bbc2-4e70-96cc-ab9e0834b633', '7f0460ab-ecc7-4c36-99b3-d697bee86cb0'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:13 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:13 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:13 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:13 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Acquiring lock "cinder-2c1b3e90-8685-463d-af3b-02e0d25b9731-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-2c1b3e90-8685-463d-af3b-02e0d25b9731-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Acquiring lock "cinder-quobyte-2c1b3e90-8685-463d-af3b-02e0d25b9731" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-quobyte-2c1b3e90-8685-463d-af3b-02e0d25b9731" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748dfdc-d85b-4699-8791-1a152f4dd57d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:14 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.903s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6bf99fb5-2429-4f65-9fc6-30cc5a3aabcd tempest-GroupSnapshotsTest-665490019 None] Delete group completed successfully. Jun 24 16:01:14 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 Jun 24 16:01:14 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:14 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.028s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Deleted volume successfully. Jun 24 16:01:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f420e774-eed2-403a-8d0b-9d37f3c04fe0 tempest-GroupSnapshotsTest-665490019 None] Group tempest-GroupSnapshotsTest-Group-542161908: creating Jun 24 16:01:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2aa15125-1b60-4284-a982-163d609c56f7 tempest-ServersNegativeTestJSON-402474199 None] Lock "cinder-4c5e3f37-0394-4623-9b58-ffe65d54003a-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f420e774-eed2-403a-8d0b-9d37f3c04fe0 tempest-GroupSnapshotsTest-665490019 None] Group tempest-GroupSnapshotsTest-Group-542161908: created successfully Jun 24 16:01:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f420e774-eed2-403a-8d0b-9d37f3c04fe0 tempest-GroupSnapshotsTest-665490019 None] Create group completed successfully. Jun 24 16:01:15 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731" returned: 0 in 1.049s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:15 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731 Jun 24 16:01:15 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:16 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2c1b3e90-8685-463d-af3b-02e0d25b9731" returned: 0 in 0.843s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-quobyte-2c1b3e90-8685-463d-af3b-02e0d25b9731" released by "delete_volume" :: held 1.948s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Created reservations ['c56a66ae-75de-4039-a868-7cae2c2a3e64', '2715c82e-5729-4944-aaf1-a68834ccfcf6', '23c12f6c-0561-4ce9-a790-ad4a60ea5eb0', '67a847b9-c80c-4d5c-8913-869a17e50bda'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:16 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:16 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (259a5768-55f0-4660-89fd-79f2664fa128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e816ae8-83c7-4906-b71b-7a276a9f907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e816ae8-83c7-4906-b71b-7a276a9f907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876749670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4824f18-791a-4351-be54-ad9cdee715d0,host='devstack@QuobyteHD#QuobyteHD',id=f8fae5d0-1dd7-46d5-bec8-aa82e8565388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:17Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8ee6bfc-e8db-4df9-bb1b-4d3e9517d113),volume_type_id=c8ee6bfc-e8db-4df9-bb1b-4d3e9517d113)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35bedde1-5f86-4dcc-a13b-cd5bc21f61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35bedde1-5f86-4dcc-a13b-cd5bc21f61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d72f22-916c-4ae3-904e-854ac12f7034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d72f22-916c-4ae3-904e-854ac12f7034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fae5d0-1dd7-46d5-bec8-aa82e8565388', 'volume_name': 'volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba81ccf-83fa-4746-813f-e9b0e9f8be23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba81ccf-83fa-4746-813f-e9b0e9f8be23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1747451-68c6-46b9-9f86-ee0b60fc5aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:16 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Volume f8fae5d0-1dd7-46d5-bec8-aa82e8565388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388', 'volume_size': 1} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4824f18-791a-4351-be54-ad9cdee715d0,created_at=2026-06-24T14:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876749670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4824f18-791a-4351-be54-ad9cdee715d0,host='devstack@QuobyteHD#QuobyteHD',id=f8fae5d0-1dd7-46d5-bec8-aa82e8565388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030f162ae93948b7a49fb0796a652fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:17Z,use_quota=True,user_id='c60a8692de8941caa4e8fd811d27a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8ee6bfc-e8db-4df9-bb1b-4d3e9517d113),volume_type_id=c8ee6bfc-e8db-4df9-bb1b-4d3e9517d113)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Creating volume f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:16 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:16 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 1073741824 Jun 24 16:01:16 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:17 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.074s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:17 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Deleted volume successfully. Jun 24 16:01:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d8d6a562-d605-42dd-bd02-e904ca7a7008 tempest-VolumesTransfersV355Test-379197672 None] Lock "cinder-2c1b3e90-8685-463d-af3b-02e0d25b9731-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:18 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 1073741824" returned: 0 in 1.166s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:18 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 Jun 24 16:01:18 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:18 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" returned: 0 in 0.825s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1747451-68c6-46b9-9f86-ee0b60fc5aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebeca9bd-4c86-4b2f-b210-9c674d205f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:18 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Volume volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 (f8fae5d0-1dd7-46d5-bec8-aa82e8565388): created successfully Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebeca9bd-4c86-4b2f-b210-9c674d205f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Flow 'volume_create_manager' (259a5768-55f0-4660-89fd-79f2664fa128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-261fc02c-06f0-433f-94a8-4a6515c8127a tempest-GroupSnapshotsTest-665490019 None] Created volume successfully. Jun 24 16:01:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] GroupSnapshot 0ef68b55-821e-4d0b-b38e-6b5179fb1f0e: creating. Jun 24 16:01:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Group snapshot 0ef68b55-821e-4d0b-b38e-6b5179fb1f0e: creating. {{(pid=93867) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 16:01:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Creating offline snapshot 1368155d-55d6-4b9c-8c85-3933d5c397c3 of volume f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:01:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7728d4-98cd-47bf-a4ca-85d134966871]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:19 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 Jun 24 16:01:19 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:20 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" returned: 0 in 0.910s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:20 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 1G Jun 24 16:01:20 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:21 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 1G" returned: 0 in 1.095s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:21 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 Jun 24 16:01:21 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:22 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3" returned: 0 in 0.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:22 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:01:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:22 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 Jun 24 16:01:22 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-23a150a1-a10c-49e4-af28-343aa437b2f0 req-d5be3dec-828f-4067-85c5-6c681a172e98 tempest-AttachVolumeNegativeTest-428975072 None] Terminate volume connection completed successfully. Jun 24 16:01:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-23a150a1-a10c-49e4-af28-343aa437b2f0 req-d5be3dec-828f-4067-85c5-6c681a172e98 tempest-AttachVolumeNegativeTest-428975072 None] Deleting attachment 33f32a2d-1f28-4718-a3e4-8305e8865341. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:01:23 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3" returned: 0 in 0.872s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:23 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info Jun 24 16:01:23 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:24 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info" returned: 0 in 0.817s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:24 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:01:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:24 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info Jun 24 16:01:24 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:24 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.info" returned: 0 in 0.814s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.462s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e4f84c64-694c-45ab-b591-698df142ae6e tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0ef68b55-821e-4d0b-b38e-6b5179fb1f0e: created successfully Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Flow 'volume_create_manager' (2d4b6520-cdad-4459-a185-2db56667e6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abae95b4-fd0c-4d48-8e39-00f95701e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abae95b4-fd0c-4d48-8e39-00f95701e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1683353981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396975ded21a4cf4a9734dea0a08775d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:25Z,use_quota=True,user_id='d96cd9bacfd54750b5e6b6760b6b05bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9906f22c-f6ea-49f9-954f-0c0b7fa094fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9906f22c-f6ea-49f9-954f-0c0b7fa094fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a157b92c-31df-4fb2-b795-addecc42f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a157b92c-31df-4fb2-b795-addecc42f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634', 'volume_name': 'volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3df4f17-9b87-4e0b-81e5-e1c553fbc3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3df4f17-9b87-4e0b-81e5-e1c553fbc3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e429795-4744-43d0-874d-4488df9aca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:25 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Volume 9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634', 'volume_size': 1} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1683353981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396975ded21a4cf4a9734dea0a08775d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:25Z,use_quota=True,user_id='d96cd9bacfd54750b5e6b6760b6b05bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Creating volume 9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:25 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:25 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 1073741824 Jun 24 16:01:25 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:26 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0ef68b55-821e-4d0b-b38e-6b5179fb1f0e: deleting Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0ef68b55-821e-4d0b-b38e-6b5179fb1f0e: deleting {{(pid=93867) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-1368155d-55d6-4b9c-8c85-3933d5c397c3" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-1368155d-55d6-4b9c-8c85-3933d5c397c3" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Deleting offline snapshot 1368155d-55d6-4b9c-8c85-3933d5c397c3 of volume f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] snapshot_file for this snap is: volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e07d56-66a5-470e-b583-07eef2f56032]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:26 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 1073741824" returned: 0 in 1.390s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:26 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 Jun 24 16:01:26 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:26 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 Jun 24 16:01:26 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:27 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3" returned: 0 in 1.141s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dbbbea-0169-43a7-a5fd-361c29b7051d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:27 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634" returned: 0 in 0.957s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e429795-4744-43d0-874d-4488df9aca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1de5905-1017-4834-b546-b6016efea6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Volume volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 (9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634): created successfully Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1de5905-1017-4834-b546-b6016efea6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Flow 'volume_create_manager' (2d4b6520-cdad-4459-a185-2db56667e6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:27 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f9000f74-d615-40cd-9007-6b69c563b64e tempest-VolumesTransfersV357Test-746322658 None] Created volume successfully. Jun 24 16:01:27 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 Jun 24 16:01:27 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:28 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" returned: 0 in 1.118s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:28 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 Jun 24 16:01:28 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:29 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-35387b97-9f03-40e1-87f6-26e98934a093 tempest-VolumesTransfersV357Test-1472151953 None] Transfer volume completed successfully. Jun 24 16:01:29 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3" returned: 0 in 0.836s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:29 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3 Jun 24 16:01:29 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:30 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388.1368155d-55d6-4b9c-8c85-3933d5c397c3" returned: 0 in 0.797s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-1368155d-55d6-4b9c-8c85-3933d5c397c3" released by "_delete_snapshot" :: held 4.087s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" released by "delete_snapshot" :: held 4.150s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:30 devstack cinder-volume[93867]: WARNING cinder.quota [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-943646637 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-943646637, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:01:30 devstack cinder-volume[93867]: WARNING cinder.quota [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-943646637 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-943646637, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['e6be226a-759d-4f9f-be00-aad5fdbb2fff', '964a4a1d-e248-458c-b495-a895f070e13b', '06fe027d-8dad-437b-8182-edb80a94a16c', 'baea4bf2-a48a-49fc-8bf2-d19fe192affa'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a0efeede-92db-4261-a146-1dff293bc8d6 tempest-GroupSnapshotsTest-665490019 None] group_snapshot 0ef68b55-821e-4d0b-b38e-6b5179fb1f0e: deleted successfully Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Acquiring lock "cinder-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Acquiring lock "cinder-quobyte-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-quobyte-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2116a11-03aa-4e91-b37e-dfe10720515f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:31 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 Jun 24 16:01:31 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "cinder-quobyte-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb654b3-f7d1-4104-8cf1-c5a7e9ecdadc]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:31 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 Jun 24 16:01:31 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:31 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634" returned: 0 in 0.836s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:31 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634 Jun 24 16:01:31 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:32 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" returned: 0 in 0.904s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:32 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388 Jun 24 16:01:32 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:32 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634" returned: 0 in 0.839s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-quobyte-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634" released by "delete_volume" :: held 1.734s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Created reservations ['7dfc4b96-f4ac-48e5-818f-6e05dcefaa5e', '8f20f129-28ec-4e93-8c2a-46cfe2e4ed3a', '50d7d3b3-cc80-44d0-9f2d-fc86fdac95fd', '9883d17f-bc8d-4dff-9ad8-155587dfb368'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:32 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:32 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:32 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" returned: 0 in 0.730s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Lock "cinder-quobyte-f8fae5d0-1dd7-46d5-bec8-aa82e8565388" released by "delete_volume" :: held 1.701s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['d54c0403-6f1d-411c-898a-e43b434170c4'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:33 devstack cinder-volume[93867]: WARNING cinder.quota [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-943646637 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-943646637, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Created reservations ['582e055f-a519-4903-8635-6a7faf43b391', '4de5054c-a223-4b78-9c84-88bdd927143d', 'a4ff38aa-a3ab-44fa-89cc-576f92810921', '133c7088-ff72-45b3-b030-b0d27b478a97'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:33 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:33 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:33 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.132s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Deleted volume successfully. Jun 24 16:01:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5c5c2fb-a7b0-4043-8a08-d4e919a46253 tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-9afdf8b8-e2ae-4b1b-88bf-d377bcb9d634-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Flow 'volume_create_manager' (b57e62a1-1e56-4653-a146-8e346d292447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6208e85-97fb-41d1-a54b-087d33533ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6208e85-97fb-41d1-a54b-087d33533ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1861350573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a845bac7-06ce-4a83-a5a9-77d90dbc3591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396975ded21a4cf4a9734dea0a08775d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:34Z,use_quota=True,user_id='d96cd9bacfd54750b5e6b6760b6b05bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d8c914-ebfa-406c-ab9c-bd5a41ba080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d8c914-ebfa-406c-ab9c-bd5a41ba080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7f6cf5-7946-4c18-8147-b186699a96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7f6cf5-7946-4c18-8147-b186699a96d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a845bac7-06ce-4a83-a5a9-77d90dbc3591', 'volume_name': 'volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ba969d-0058-4b83-b7aa-88ed67d8e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ba969d-0058-4b83-b7aa-88ed67d8e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b61d25-c42c-48d6-97e0-efb291a5a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:34 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Volume a845bac7-06ce-4a83-a5a9-77d90dbc3591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591', 'volume_size': 1} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1861350573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a845bac7-06ce-4a83-a5a9-77d90dbc3591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396975ded21a4cf4a9734dea0a08775d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:34Z,use_quota=True,user_id='d96cd9bacfd54750b5e6b6760b6b05bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Creating volume a845bac7-06ce-4a83-a5a9-77d90dbc3591 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:34 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:34 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 1073741824 Jun 24 16:01:34 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:34 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.201s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:34 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8f9dee28-9ff9-4cb1-ab44-b1f5c63a1fc4 tempest-GroupSnapshotsTest-665490019 None] Delete group completed successfully. Jun 24 16:01:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 1073741824" returned: 0 in 1.056s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:35 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:35 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 Jun 24 16:01:35 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:36 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591" returned: 0 in 0.844s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=131,cinder:DELETE=9,cinder:SELECT=127,cinder:INSERT=36 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b61d25-c42c-48d6-97e0-efb291a5a93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21abd8cb-5eef-46c2-b4ef-0bc501181497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=118,cinder:UPDATE=150,cinder:DELETE=7,cinder:INSERT=31 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:01:36 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Volume volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 (a845bac7-06ce-4a83-a5a9-77d90dbc3591): created successfully Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21abd8cb-5eef-46c2-b4ef-0bc501181497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Flow 'volume_create_manager' (b57e62a1-1e56-4653-a146-8e346d292447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0f8bb007-5430-46b4-a3e4-da39a9fc7bb1 tempest-VolumesTransfersV357Test-746322658 None] Created volume successfully. Jun 24 16:01:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Acquiring lock "cinder-a845bac7-06ce-4a83-a5a9-77d90dbc3591-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-a845bac7-06ce-4a83-a5a9-77d90dbc3591-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Acquiring lock "cinder-quobyte-a845bac7-06ce-4a83-a5a9-77d90dbc3591" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-quobyte-a845bac7-06ce-4a83-a5a9-77d90dbc3591" acquired by "delete_volume" :: waited 0.049s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c610fd4c-ede7-4dea-815a-d3a87aa8973e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:37 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 Jun 24 16:01:37 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:38 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591" returned: 0 in 0.864s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:38 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591 Jun 24 16:01:38 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:39 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:39 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:39 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a845bac7-06ce-4a83-a5a9-77d90dbc3591" returned: 0 in 0.797s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-quobyte-a845bac7-06ce-4a83-a5a9-77d90dbc3591" released by "delete_volume" :: held 1.743s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Created reservations ['61568632-8a3a-4ff8-8f68-c0b5faec4493', '9d7d82b0-113b-46e4-a9de-6a3d2026358d', '59a7eff4-7040-4800-9ec5-6294909d3012', 'a5744d45-3cb9-4372-9673-ba85df2656b7'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:39 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:39 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:40 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.286s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:01:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:01:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:01:41 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.555s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:41 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Deleted volume successfully. Jun 24 16:01:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-533f3151-800d-43fa-9ad0-c6eac7bd1eac tempest-VolumesTransfersV357Test-1079042957 None] Lock "cinder-a845bac7-06ce-4a83-a5a9-77d90dbc3591-delete_volume" released by "delete_volume" :: held 3.752s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Flow 'volume_create_manager' (426caed4-14c1-429c-8ee7-0978cb5a8b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dbb425-ec8d-4568-8ef1-1df4cdf49961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dbb425-ec8d-4568-8ef1-1df4cdf49961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-43232965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64f5bea-32fb-430b-8a5a-2103ffab26b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a663e58f72740a1af960030d60b0df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:48Z,use_quota=True,user_id='855a3a5a8b334bd9bed9bb8e17a994f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74d93cb-78ba-435f-98ba-a071b4379196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74d93cb-78ba-435f-98ba-a071b4379196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527753ca-b2c8-4915-9922-4700e1f63df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527753ca-b2c8-4915-9922-4700e1f63df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64f5bea-32fb-430b-8a5a-2103ffab26b2', 'volume_name': 'volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2', 'volume_size': 2}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a426bc1e-4d1e-46be-913f-7ed58c3ec595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a426bc1e-4d1e-46be-913f-7ed58c3ec595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5aa8c91-c5d2-40f0-8f50-8621df78eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Volume a64f5bea-32fb-430b-8a5a-2103ffab26b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2', 'volume_size': 2} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-43232965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64f5bea-32fb-430b-8a5a-2103ffab26b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a663e58f72740a1af960030d60b0df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:01:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:01:48Z,use_quota=True,user_id='855a3a5a8b334bd9bed9bb8e17a994f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Creating volume a64f5bea-32fb-430b-8a5a-2103ffab26b2 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:01:48 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:01:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 2147483648 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:48 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 2147483648 Jun 24 16:01:48 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:49 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 2147483648" returned: 0 in 1.210s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:49 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 Jun 24 16:01:49 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:50 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2" returned: 0 in 0.923s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5aa8c91-c5d2-40f0-8f50-8621df78eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2', 'volume_size': 2}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c4f501-fcae-4b2b-9e9e-dc087e7b9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:01:50 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Volume volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 (a64f5bea-32fb-430b-8a5a-2103ffab26b2): created successfully Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c4f501-fcae-4b2b-9e9e-dc087e7b9e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:01:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Flow 'volume_create_manager' (426caed4-14c1-429c-8ee7-0978cb5a8b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:01:50 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-996aea3f-85c9-49ca-8bc0-079996093fa3 tempest-VolumesCloneNegativeTest-1553595713 None] Created volume successfully. Jun 24 16:01:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Acquiring lock "cinder-a64f5bea-32fb-430b-8a5a-2103ffab26b2-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "cinder-a64f5bea-32fb-430b-8a5a-2103ffab26b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Acquiring lock "cinder-quobyte-a64f5bea-32fb-430b-8a5a-2103ffab26b2" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:01:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "cinder-quobyte-a64f5bea-32fb-430b-8a5a-2103ffab26b2" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:01:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b94d601-59ca-4794-b5e6-26c6dd513096]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:01:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:52 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 Jun 24 16:01:52 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:52 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2" returned: 0 in 0.804s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:52 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2 Jun 24 16:01:52 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:53 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a64f5bea-32fb-430b-8a5a-2103ffab26b2" returned: 0 in 0.855s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "cinder-quobyte-a64f5bea-32fb-430b-8a5a-2103ffab26b2" released by "delete_volume" :: held 1.718s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Created reservations ['4b75ac0b-8c3e-458d-9f8f-c8ca46e57b60', 'e18ce845-7f85-43bc-9b14-6587ceb2f701', '9f7dcc85-44b4-4d5f-9c6f-4caeb50ec6d1', 'a3a30cdd-8e74-46b2-89a6-728b008c01e3'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:01:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:01:53 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:01:53 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:01:54 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jun 24 16:01:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.952s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:01:54 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:01:54 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Deleted volume successfully. Jun 24 16:01:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e43005a4-9d34-489c-bc66-fe06405a3e02 tempest-VolumesCloneNegativeTest-1553595713 None] Lock "cinder-a64f5bea-32fb-430b-8a5a-2103ffab26b2-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Flow 'volume_create_manager' (2b469c1d-9b56-442b-85d9-ae0a91416556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c598f52-3382-4924-9bcd-fcde3ee35ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c598f52-3382-4924-9bcd-fcde3ee35ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1841388789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f90ab5092340b48f682efe7756875b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:00Z,use_quota=True,user_id='9e35cb945d884bd99c16c75034ee91e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cc9f26-8420-418a-87ce-f3fb18f72e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cc9f26-8420-418a-87ce-f3fb18f72e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6583a464-b0d2-4477-898c-7264608e90bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6583a464-b0d2-4477-898c-7264608e90bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54', 'volume_name': 'volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcffdf61-2291-4c63-bbd7-159587e2f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcffdf61-2291-4c63-bbd7-159587e2f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbf1e11-11f2-4317-a3d6-84238250b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:00 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Volume ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 16:02:00 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Trying to clone ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 from image cec30253-e3a4-40e1-82d3-11c0f2e0458f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:02:01 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:02:01 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Image download 20.69 MB at 20.69 MB/s Jun 24 16:02:01 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5a3f2f-a38d-4c48-bfe2-cfbe3d39c0f7]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:01 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD Jun 24 16:02:01 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:02 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD" returned: 0 in 1.198s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:02 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f is fetched for user 9e35cb945d884bd99c16c75034ee91e8. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:02:02 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5fbef4-3699-4e8b-8415-219a2cad2cc6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:03 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD Jun 24 16:02:03 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD" returned: 0 in 1.859s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:04 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1841388789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f90ab5092340b48f682efe7756875b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:00Z,use_quota=True,user_id='9e35cb945d884bd99c16c75034ee91e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Creating volume ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:04 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:04 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 1073741824 Jun 24 16:02:04 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Flow 'volume_create_manager' (58ac7b88-33e5-4ce9-a965-1e5b6d9fca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089f1a96-95ae-4b28-a7b9-aa3eaad6914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089f1a96-95ae-4b28-a7b9-aa3eaad6914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-518486726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea41e11-fd32-4c43-9fc9-4448319057fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5d88bab49a4aa6bab520f84b72e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:05Z,use_quota=True,user_id='cdb93eb44b7149ed9e7b1eb8f0788a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9147fd2b-43d4-470c-8864-4e5db9bbe3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9147fd2b-43d4-470c-8864-4e5db9bbe3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4fce97-e019-463c-9b7b-6ab55eebb931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4fce97-e019-463c-9b7b-6ab55eebb931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea41e11-fd32-4c43-9fc9-4448319057fe', 'volume_name': 'volume-cea41e11-fd32-4c43-9fc9-4448319057fe', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e82fd2-0621-40ca-8996-76785f7d3c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e82fd2-0621-40ca-8996-76785f7d3c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ad3a51-b363-46d5-a7c1-94f384560a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Volume cea41e11-fd32-4c43-9fc9-4448319057fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea41e11-fd32-4c43-9fc9-4448319057fe', 'volume_size': 1} Jun 24 16:02:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:06 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 1073741824" returned: 0 in 1.878s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:06 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:06 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:07 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 0 in 0.869s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] <== create_volume: return (2904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.907s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.893s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-518486726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea41e11-fd32-4c43-9fc9-4448319057fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5d88bab49a4aa6bab520f84b72e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:05Z,use_quota=True,user_id='cdb93eb44b7149ed9e7b1eb8f0788a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Creating volume cea41e11-fd32-4c43-9fc9-4448319057fe {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:07 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Attempting download of cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:02:07 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe 1073741824 Jun 24 16:02:07 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f02c1-4dd8-4567-afeb-eb8a2184af22]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:08 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn Jun 24 16:02:08 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:09 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn" returned: 0 in 1.380s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:09 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn Jun 24 16:02:09 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:09 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe 1073741824" returned: 0 in 1.988s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:09 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe Jun 24 16:02:09 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:10 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn" returned: 1 in 1.016s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_avivhnmn' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf209f-a0f9-4a77-8d0e-df7ce8a46850]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:10 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD Jun 24 16:02:10 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:10 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe" returned: 0 in 0.932s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] <== create_volume: return (2988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.992s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ad3a51-b363-46d5-a7c1-94f384560a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea41e11-fd32-4c43-9fc9-4448319057fe', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69cf7f8-57ee-4d2e-8a6e-5ab3c5f070e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:10 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Volume volume-cea41e11-fd32-4c43-9fc9-4448319057fe (cea41e11-fd32-4c43-9fc9-4448319057fe): created successfully Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69cf7f8-57ee-4d2e-8a6e-5ab3c5f070e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Flow 'volume_create_manager' (58ac7b88-33e5-4ce9-a965-1e5b6d9fca68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:10 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a2a51d0b-8092-4f7f-9db8-7371f0351155 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Created volume successfully. Jun 24 16:02:11 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] cec30253-e3a4-40e1-82d3-11c0f2e0458f was qcow2, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:11 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:11 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "cinder-cea41e11-fd32-4c43-9fc9-4448319057fe-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "cinder-cea41e11-fd32-4c43-9fc9-4448319057fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "cinder-quobyte-cea41e11-fd32-4c43-9fc9-4448319057fe" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "cinder-quobyte-cea41e11-fd32-4c43-9fc9-4448319057fe" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557d9db-64b6-4d49-8ce9-ddc2f3b5df82]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:12 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe Jun 24 16:02:12 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:12 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe" returned: 0 in 0.892s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:12 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe Jun 24 16:02:12 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:13 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 0 in 2.051s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_u6veb72wdevstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:02:13 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Converted 112.00 MB image at 54.59 MB/s Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:13 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 1G Jun 24 16:02:13 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:13 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-cea41e11-fd32-4c43-9fc9-4448319057fe" returned: 0 in 0.657s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "cinder-quobyte-cea41e11-fd32-4c43-9fc9-4448319057fe" released by "delete_volume" :: held 1.603s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Created reservations ['b154689a-642c-474c-bb83-c5a383d16395', 'd0f6caf7-1b9b-4d64-9375-eadc77872f09', 'a6e82e60-9683-4a2d-9dac-86782c42382e', 'ac889c67-bf0c-481f-834b-2ffdd8a8dcd0'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:13 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:02:13 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:13 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 1G" returned: 0 in 0.783s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e41af2-1abd-42cd-b0bc-6f69b794b87f]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:14 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:14 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:14 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.745s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:02:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Deleted volume successfully. Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9076d58-b862-4e75-b41a-0837281629e8 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "cinder-cea41e11-fd32-4c43-9fc9-4448319057fe-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:14 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 0 in 0.859s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Flow 'volume_create_manager' (99cde243-9035-4c8c-b2ab-6ca52446a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc68c1d-474f-498e-809d-6eab3cbae9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc68c1d-474f-498e-809d-6eab3cbae9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1986538722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be568b46-2ed8-4c42-ab87-59ab86182522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5d88bab49a4aa6bab520f84b72e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:15Z,use_quota=True,user_id='cdb93eb44b7149ed9e7b1eb8f0788a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94352c77-e587-47a4-a2b9-a75df2fd75fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94352c77-e587-47a4-a2b9-a75df2fd75fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1084d974-126e-4901-a5f7-6af52379d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1084d974-126e-4901-a5f7-6af52379d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be568b46-2ed8-4c42-ab87-59ab86182522', 'volume_name': 'volume-be568b46-2ed8-4c42-ab87-59ab86182522', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bee9091-10bc-4661-9781-4675d7a7c3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bee9091-10bc-4661-9781-4675d7a7c3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7826d-40bf-4b96-9ecf-9225aa7972d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:14 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Volume be568b46-2ed8-4c42-ab87-59ab86182522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be568b46-2ed8-4c42-ab87-59ab86182522', 'volume_size': 1} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1986538722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be568b46-2ed8-4c42-ab87-59ab86182522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef5d88bab49a4aa6bab520f84b72e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:15Z,use_quota=True,user_id='cdb93eb44b7149ed9e7b1eb8f0788a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Creating volume be568b46-2ed8-4c42-ab87-59ab86182522 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:14 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:14 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:14 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:14 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 1073741824 Jun 24 16:02:14 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:15 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 1 in 0.786s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Downloaded image cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f for user 9e35cb945d884bd99c16c75034ee91e8 is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Marking volume ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Copying metadata from image cec30253-e3a4-40e1-82d3-11c0f2e0458f to ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Creating volume glance metadata for volume ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 backed by image cec30253-e3a4-40e1-82d3-11c0f2e0458f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbf1e11-11f2-4317-a3d6-84238250b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad43f7d-00d5-40ae-871b-a74bb15a7588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:15 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Volume volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 (ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54): created successfully Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad43f7d-00d5-40ae-871b-a74bb15a7588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Flow 'volume_create_manager' (2b469c1d-9b56-442b-85d9-ae0a91416556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:15 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f0530348-c769-4c0d-ac87-97ecd2455a8d tempest-VolumesExtendTest-1926421495 None] Created volume successfully. Jun 24 16:02:15 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 1073741824" returned: 0 in 0.967s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:15 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 Jun 24 16:02:15 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:16 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522" returned: 0 in 0.637s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7826d-40bf-4b96-9ecf-9225aa7972d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be568b46-2ed8-4c42-ab87-59ab86182522', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8864e676-af49-4473-9eab-88f87d0d5512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:16 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Volume volume-be568b46-2ed8-4c42-ab87-59ab86182522 (be568b46-2ed8-4c42-ab87-59ab86182522): created successfully Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8864e676-af49-4473-9eab-88f87d0d5512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Flow 'volume_create_manager' (99cde243-9035-4c8c-b2ab-6ca52446a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2f4f1b1b-a100-4cff-aed8-cf5c6a44df42 tempest-VolumeQuotasAdminTestJSON-1280235798 None] Created volume successfully. Jun 24 16:02:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0685a921-a35f-43b0-b516-7b6c92922b44]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:17 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:17 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-72223740-4733-433d-8760-57418c30a945 tempest-VolumeQuotasAdminTestJSON-381520241 None] Transfer volume completed successfully. Jun 24 16:02:17 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 0 in 0.785s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:18 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:18 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:18 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Acquiring lock "cinder-be568b46-2ed8-4c42-ab87-59ab86182522-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 1 in 0.967s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:02:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 2G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Lock "cinder-be568b46-2ed8-4c42-ab87-59ab86182522-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Acquiring lock "cinder-quobyte-be568b46-2ed8-4c42-ab87-59ab86182522" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Lock "cinder-quobyte-be568b46-2ed8-4c42-ab87-59ab86182522" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d816a-38e3-4903-9562-53307791449d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 2G" returned: 0 in 0.155s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.967s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c5316899-2499-4230-8f1f-e6af07ac7f72 tempest-VolumesExtendTest-1926421495 None] Extend volume completed successfully. Jun 24 16:02:19 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 Jun 24 16:02:19 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-quobyte-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44ad6b-afb7-49f1-a3e9-c701862c6b27]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:19 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:19 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:19 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522" returned: 0 in 0.868s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:19 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522 Jun 24 16:02:19 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:20 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 0 in 0.806s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:20 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-be568b46-2ed8-4c42-ab87-59ab86182522" returned: 0 in 0.682s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Lock "cinder-quobyte-be568b46-2ed8-4c42-ab87-59ab86182522" released by "delete_volume" :: held 1.599s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Created reservations ['9d8ea37e-8371-480d-975b-d543211623bd', '6aa1e9ff-1a60-4eb6-9af6-e153360f32c4', '353962b9-b170-4ad0-8585-6b70506fb61a', 'f53dc3c9-5ae4-40bc-84a3-55c28e061c29'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:02:20 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:20 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:20 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:02:20 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:21 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 1 in 0.839s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:02:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:21 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54 Jun 24 16:02:21 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:21 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.675s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:21 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:02:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Deleted volume successfully. Jun 24 16:02:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aaade862-7eab-400b-87f2-6028ae0ca897 tempest-VolumeQuotasAdminTestJSON-1322725006 None] Lock "cinder-be568b46-2ed8-4c42-ab87-59ab86182522-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:22 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" returned: 0 in 0.725s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54" released by "delete_volume" :: held 2.453s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Created reservations ['5f31da4b-b466-4c4b-8c5e-4bfffea352f5', '20eaf8cb-c647-4ae6-9be8-dfacca633647', '59f412c6-849b-423a-acdb-e1a177e6c5be', 'de1d9516-7285-4b80-a32e-1316ff023874'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:22 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:02:22 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:22 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.651s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:02:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Deleted volume successfully. Jun 24 16:02:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ab5fc926-bbdd-4d45-ade6-df3aa383d439 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-ca6b6dd7-ff8e-4d4e-8fd5-fb10a7ae4a54-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Flow 'volume_create_manager' (509397c2-e4ce-4fdd-9d72-d79cc93cc42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe19d7f-e1b3-41c6-acec-b55b22dc731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe19d7f-e1b3-41c6-acec-b55b22dc731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1138685844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee458fc-fb29-4994-9262-8ab4d2b73382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f90ab5092340b48f682efe7756875b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:23Z,use_quota=True,user_id='9e35cb945d884bd99c16c75034ee91e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f2cbde-2403-4907-a42a-ac722055ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f2cbde-2403-4907-a42a-ac722055ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ab3743-b3be-40a0-97b1-bb77341f8991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ab3743-b3be-40a0-97b1-bb77341f8991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee458fc-fb29-4994-9262-8ab4d2b73382', 'volume_name': 'volume-dee458fc-fb29-4994-9262-8ab4d2b73382', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c583541f-a511-4b48-8451-93730774acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c583541f-a511-4b48-8451-93730774acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5b85f5-eeea-4f62-b490-46daa662ab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Volume dee458fc-fb29-4994-9262-8ab4d2b73382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee458fc-fb29-4994-9262-8ab4d2b73382', 'volume_size': 1} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1138685844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee458fc-fb29-4994-9262-8ab4d2b73382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f90ab5092340b48f682efe7756875b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:23Z,use_quota=True,user_id='9e35cb945d884bd99c16c75034ee91e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Creating volume dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:23 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:23 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 1073741824 Jun 24 16:02:23 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:24 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 1073741824" returned: 0 in 0.932s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:24 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 Jun 24 16:02:24 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:25 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382" returned: 0 in 0.715s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5b85f5-eeea-4f62-b490-46daa662ab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee458fc-fb29-4994-9262-8ab4d2b73382', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed5b81f-6388-406f-ba5f-9b094a49c98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:25 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Volume volume-dee458fc-fb29-4994-9262-8ab4d2b73382 (dee458fc-fb29-4994-9262-8ab4d2b73382): created successfully Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed5b81f-6388-406f-ba5f-9b094a49c98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Flow 'volume_create_manager' (509397c2-e4ce-4fdd-9d72-d79cc93cc42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:25 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-413ba55d-7ed8-41ca-97d9-89cadc3076b5 tempest-VolumesExtendTest-1926421495 None] Created volume successfully. Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Creating offline snapshot 885e4a5e-acea-4484-a8c4-55b4f520e6db of volume dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d082760-3d08-4688-9b6a-31d518e79c41]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:25 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 Jun 24 16:02:25 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Flow 'volume_create_manager' (d3c2f977-3c5c-4e38-9e94-9f70ddbc888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced86189-b1bc-4057-8625-6fff81534072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced86189-b1bc-4057-8625-6fff81534072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1775915809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8ffbd1-4a31-44c6-9e29-7359c5704ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692bd155bf4f428f9b6712342bba8e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:26Z,use_quota=True,user_id='b5906a21253d42e7a86a54b060169b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcf7ab0-8043-47a9-a662-257e29026e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcf7ab0-8043-47a9-a662-257e29026e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e6a052-169b-4117-b21a-367670cbe3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e6a052-169b-4117-b21a-367670cbe3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8ffbd1-4a31-44c6-9e29-7359c5704ffb', 'volume_name': 'volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d913de0-6814-40f2-b6e6-6ae87020db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d913de0-6814-40f2-b6e6-6ae87020db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e662cf7-14a8-4ea6-92c1-cddca44585c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:26 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Volume 3d8ffbd1-4a31-44c6-9e29-7359c5704ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb', 'volume_size': 1} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:26 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382" returned: 0 in 0.861s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:26 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db 1G Jun 24 16:02:26 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:27 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db 1G" returned: 0 in 0.880s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee458fc-fb29-4994-9262-8ab4d2b73382 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:27 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee458fc-fb29-4994-9262-8ab4d2b73382 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db Jun 24 16:02:27 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:28 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee458fc-fb29-4994-9262-8ab4d2b73382 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db" returned: 0 in 0.751s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:28 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db is being set with open permissions: ugo+rw Jun 24 16:02:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:28 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db Jun 24 16:02:28 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:29 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db" returned: 0 in 0.740s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:29 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info Jun 24 16:02:29 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Flow 'volume_create_manager' (f046dea8-e3a6-42e9-8a8d-a5a9e11e10ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d66118-47ae-410f-bf6f-f4877229471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d66118-47ae-410f-bf6f-f4877229471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-183777358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc941ba-545e-4a74-923c-867ec3214712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a443d651a77481db998e50d0d22df71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:30Z,use_quota=True,user_id='ec218a826a06426eb9fd7169e8bf6ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8eb4d9-dc03-44f3-bf83-973d1643bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8eb4d9-dc03-44f3-bf83-973d1643bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2120711-57ea-4cf5-9b52-f3d40652dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2120711-57ea-4cf5-9b52-f3d40652dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc941ba-545e-4a74-923c-867ec3214712', 'volume_name': 'volume-bfc941ba-545e-4a74-923c-867ec3214712', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0be583-5a34-47ec-ab00-1751c236dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0be583-5a34-47ec-ab00-1751c236dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a9ca6c-2d80-46e2-91f0-f4cf0d4201c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:29 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Volume bfc941ba-545e-4a74-923c-867ec3214712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc941ba-545e-4a74-923c-867ec3214712', 'volume_size': 1} Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:29 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info" returned: 0 in 0.750s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:29 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info is being set with open permissions: ugo+rw Jun 24 16:02:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:29 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info Jun 24 16:02:29 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:30 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.info" returned: 0 in 0.673s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.774s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.263s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1775915809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8ffbd1-4a31-44c6-9e29-7359c5704ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692bd155bf4f428f9b6712342bba8e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:26Z,use_quota=True,user_id='b5906a21253d42e7a86a54b060169b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Creating volume 3d8ffbd1-4a31-44c6-9e29-7359c5704ffb {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:30 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:30 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb 1073741824 Jun 24 16:02:30 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-3629216f-92f8-4a55-8ea8-01e01c190fc4 tempest-VolumesExtendTest-1926421495 None] Create snapshot completed successfully Jun 24 16:02:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:31 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb 1073741824" returned: 0 in 0.888s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:31 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb Jun 24 16:02:31 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:32 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.320s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-183777358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc941ba-545e-4a74-923c-867ec3214712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a443d651a77481db998e50d0d22df71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:30Z,use_quota=True,user_id='ec218a826a06426eb9fd7169e8bf6ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Creating volume bfc941ba-545e-4a74-923c-867ec3214712 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:32 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e662cf7-14a8-4ea6-92c1-cddca44585c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:32 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 1073741824 Jun 24 16:02:32 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5835f7f8-a03d-4321-981f-0182991651a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:32 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Volume volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb (3d8ffbd1-4a31-44c6-9e29-7359c5704ffb): created successfully Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5835f7f8-a03d-4321-981f-0182991651a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Flow 'volume_create_manager' (d3c2f977-3c5c-4e38-9e94-9f70ddbc888d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-677eb3bc-3708-4690-afbe-66ff436865f6 tempest-AttachVolumeNegativeTest-428975072 None] Created volume successfully. Jun 24 16:02:33 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 1073741824" returned: 0 in 0.883s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:33 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 Jun 24 16:02:33 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:33 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712" returned: 0 in 0.659s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.608s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1059eb-838c-4815-946e-be01018ed330]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a9ca6c-2d80-46e2-91f0-f4cf0d4201c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc941ba-545e-4a74-923c-867ec3214712', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3f739-8e52-40ef-b4d1-87339c4bef82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Volume volume-bfc941ba-545e-4a74-923c-867ec3214712 (bfc941ba-545e-4a74-923c-867ec3214712): created successfully Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3f739-8e52-40ef-b4d1-87339c4bef82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Flow 'volume_create_manager' (f046dea8-e3a6-42e9-8a8d-a5a9e11e10ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f161ce16-5c5d-49d4-b0f9-3dcd21f3193f tempest-AttachVolumeTestJSON-551800762 None] Created volume successfully. Jun 24 16:02:33 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 Jun 24 16:02:33 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:34 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db 2G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db 2G" returned: 0 in 0.183s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.993s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-06049562-7557-4afb-a435-ac6e88b2ac8f tempest-VolumesExtendTest-1926421495 None] Extend volume completed successfully. Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-885e4a5e-acea-4484-a8c4-55b4f520e6db-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-885e4a5e-acea-4484-a8c4-55b4f520e6db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-quobyte-dee458fc-fb29-4994-9262-8ab4d2b73382" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-dee458fc-fb29-4994-9262-8ab4d2b73382" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-quobyte-885e4a5e-acea-4484-a8c4-55b4f520e6db" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-885e4a5e-acea-4484-a8c4-55b4f520e6db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Deleting offline snapshot 885e4a5e-acea-4484-a8c4-55b4f520e6db of volume dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] snapshot_file for this snap is: volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f1eae-22d2-45ff-84f0-1fea407f1db7]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:35 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db Jun 24 16:02:35 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a950c02-54ae-44a3-833c-99219ef54422]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:36 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb Jun 24 16:02:36 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:36 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db" returned: 0 in 0.857s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dee458fc-fb29-4994-9262-8ab4d2b73382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb8b75d-8313-4137-a92d-4c3fa1423914]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:36 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 Jun 24 16:02:36 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:36 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" returned: 0 in 0.933s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.953s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=75,cinder:DELETE=6,cinder:SELECT=52,cinder:INSERT=19 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:02:36 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=65,cinder:SELECT=60,cinder:INSERT=22,cinder:DELETE=8 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:02:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '521f3096-5e41-447b-bacc-070ecca4bf83', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:02:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-ffe7535a-b30c-4b63-b2a4-eca0083cbd3f req-896795fa-82a0-422b-b042-f6cc3657b55b tempest-AttachVolumeNegativeTest-428975072 None] attachment_update completed successfully. Jun 24 16:02:37 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382" returned: 0 in 0.896s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:37 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db Jun 24 16:02:37 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:38 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8836005d-5571-48da-9bb9-9b4bb063c41f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:38 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 Jun 24 16:02:38 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:38 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db" returned: 0 in 0.929s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:38 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db Jun 24 16:02:38 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:39 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:02:39 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:39 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382.885e4a5e-acea-4484-a8c4-55b4f520e6db" returned: 0 in 0.764s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-885e4a5e-acea-4484-a8c4-55b4f520e6db" released by "_delete_snapshot" :: held 3.600s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-dee458fc-fb29-4994-9262-8ab4d2b73382" released by "delete_snapshot" :: held 3.627s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Created reservations ['d4f94b9f-1efd-47f7-a032-43fb5d0ca785', 'fa5dfee1-3286-437e-b01d-41669de658d1', '715d2bab-bada-4cba-b85c-08db861d50cf', 'f6975f41-9513-479c-84a9-5310fef0eeee'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:02:39 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712" returned: 0 in 1.099s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.121s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-bfc941ba-545e-4a74-923c-867ec3214712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9000428a-6576-427c-b937-77a31ca8a7c0', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:02:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Delete snapshot completed successfully. Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a1ab0b4f-538b-4db4-a8ee-407308fe4892 tempest-VolumesExtendTest-1926421495 None] Lock "cinder-885e4a5e-acea-4484-a8c4-55b4f520e6db-delete_snapshot" released by "delete_snapshot" :: held 3.836s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-a3edcdd9-57ef-4047-86db-7104baeedb26 req-9dda6df9-9598-4e24-adcb-361ffc19814c tempest-AttachVolumeTestJSON-551800762 None] attachment_update completed successfully. Jun 24 16:02:39 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.792s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:02:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-dee458fc-fb29-4994-9262-8ab4d2b73382-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Lock "cinder-dee458fc-fb29-4994-9262-8ab4d2b73382-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Acquiring lock "cinder-quobyte-dee458fc-fb29-4994-9262-8ab4d2b73382" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-dee458fc-fb29-4994-9262-8ab4d2b73382" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4c31de-0a4e-44d3-bdd2-026589ef0892]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:40 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 Jun 24 16:02:40 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:40 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382" returned: 0 in 0.831s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:40 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382 Jun 24 16:02:40 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:41 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dee458fc-fb29-4994-9262-8ab4d2b73382" returned: 0 in 0.682s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Lock "cinder-quobyte-dee458fc-fb29-4994-9262-8ab4d2b73382" released by "delete_volume" :: held 1.583s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Created reservations ['f2058e99-a499-4e7d-ac9c-26ed5b3b57ca', '97b064c4-42ff-4de2-b65a-f5e421f46f14', '6bdeccdf-c6a4-45e2-81e7-5ec1d6acf949', 'c0b08419-c762-47dc-a90b-4315255a974f'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:41 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:02:41 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:42 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.799s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:42 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:02:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Deleted volume successfully. Jun 24 16:02:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d31efa54-c144-4363-96a6-1a1e669a3f7a tempest-VolumesExtendTest-1926421495 None] Lock "cinder-dee458fc-fb29-4994-9262-8ab4d2b73382-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:02:43 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Flow 'volume_create_manager' (80aa69a4-0d32-4747-b202-59bd47d49de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cacd01-b1d4-4a1b-bd38-ec4517be15a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cacd01-b1d4-4a1b-bd38-ec4517be15a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-585509708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e53444-e527-49d5-bf17-da336166d4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936d702612fc4409a096691df568303b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:44Z,use_quota=True,user_id='e66a31cfe15a444fb3064acbe0e6ce78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4663f8c-a09e-4397-9d01-6602f85fac9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4663f8c-a09e-4397-9d01-6602f85fac9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1307a3d2-3db4-4776-b7da-21a2e12ddd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1307a3d2-3db4-4776-b7da-21a2e12ddd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e53444-e527-49d5-bf17-da336166d4a5', 'volume_name': 'volume-65e53444-e527-49d5-bf17-da336166d4a5', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c14526-fb1e-460d-8f11-34f46093c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c14526-fb1e-460d-8f11-34f46093c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0bc980-0632-48b8-bd11-e9c15035c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:44 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Volume 65e53444-e527-49d5-bf17-da336166d4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e53444-e527-49d5-bf17-da336166d4a5', 'volume_size': 1} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-585509708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e53444-e527-49d5-bf17-da336166d4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='936d702612fc4409a096691df568303b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:02:44Z,use_quota=True,user_id='e66a31cfe15a444fb3064acbe0e6ce78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Creating volume 65e53444-e527-49d5-bf17-da336166d4a5 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:02:44 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:44 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 1073741824 Jun 24 16:02:44 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:44 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-68f6a5ab-3440-410a-a697-850fcc3dbf66 req-2aab4848-39b8-4bd1-8454-a2ad43c28bdd tempest-AttachVolumeNegativeTest-428975072 None] Terminate volume connection completed successfully. Jun 24 16:02:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-68f6a5ab-3440-410a-a697-850fcc3dbf66 req-2aab4848-39b8-4bd1-8454-a2ad43c28bdd tempest-AttachVolumeNegativeTest-428975072 None] Deleting attachment 521f3096-5e41-447b-bacc-070ecca4bf83. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:02:45 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 1073741824" returned: 0 in 0.959s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:02:45 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 Jun 24 16:02:45 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:02:45 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5" returned: 0 in 0.666s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0bc980-0632-48b8-bd11-e9c15035c620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e53444-e527-49d5-bf17-da336166d4a5', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9625a2b4-476e-4e61-a54f-90bc10495f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:02:45 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Volume volume-65e53444-e527-49d5-bf17-da336166d4a5 (65e53444-e527-49d5-bf17-da336166d4a5): created successfully Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9625a2b4-476e-4e61-a54f-90bc10495f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:02:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Flow 'volume_create_manager' (80aa69a4-0d32-4747-b202-59bd47d49de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:02:45 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-871db368-959d-4552-a3de-0651e2110b80 tempest-VolumesNegativeTest-2073118811 None] Created volume successfully. Jun 24 16:02:55 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:02:55 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Flow 'volume_create_manager' (a0383e79-fee3-4dc4-bd39-631f2c5f8492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffcf5fc-19e8-4c01-b973-533fbdd7dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffcf5fc-19e8-4c01-b973-533fbdd7dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-973657043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322d04e6-685b-4847-9506-c748734f5ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d7dcc13d7a497f915d8862ba6379a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:19Z,use_quota=True,user_id='518be0849038411fb92ec0fd2f58707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f76a41c8-3b08-4943-917a-5f7cc46545f5),volume_type_id=f76a41c8-3b08-4943-917a-5f7cc46545f5)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3022e43f-e16c-4c91-b604-da0b93dbd956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3022e43f-e16c-4c91-b604-da0b93dbd956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b747832c-2011-4a12-be9a-6a5feab4bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b747832c-2011-4a12-be9a-6a5feab4bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '322d04e6-685b-4847-9506-c748734f5ba2', 'volume_name': 'volume-322d04e6-685b-4847-9506-c748734f5ba2', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c85c69-1c17-498d-aaa4-f6126fabb629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c85c69-1c17-498d-aaa4-f6126fabb629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3b8c9c-6b3b-4da5-bcba-418f0344990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:18 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Volume 322d04e6-685b-4847-9506-c748734f5ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-322d04e6-685b-4847-9506-c748734f5ba2', 'volume_size': 1} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-973657043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322d04e6-685b-4847-9506-c748734f5ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d7dcc13d7a497f915d8862ba6379a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:19Z,use_quota=True,user_id='518be0849038411fb92ec0fd2f58707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f76a41c8-3b08-4943-917a-5f7cc46545f5),volume_type_id=f76a41c8-3b08-4943-917a-5f7cc46545f5)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Creating volume 322d04e6-685b-4847-9506-c748734f5ba2 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:03:18 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:03:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:18 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 1073741824 Jun 24 16:03:18 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Flow 'volume_create_manager' (a7cffe89-8ecb-48fd-adc4-ea6259e295ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20535fb6-4444-474c-aea6-e6c26a594a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20535fb6-4444-474c-aea6-e6c26a594a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1005526802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34609381-4d8e-43a1-9d8a-3626f968d9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d7dcc13d7a497f915d8862ba6379a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:19Z,use_quota=True,user_id='518be0849038411fb92ec0fd2f58707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea211447-08fb-4f78-935c-14f5178d2b6b),volume_type_id=ea211447-08fb-4f78-935c-14f5178d2b6b)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7744068-07af-4a11-8d1d-4facac0ebfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7744068-07af-4a11-8d1d-4facac0ebfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d6fb0b-af21-4e12-a010-e7f794c1f05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d6fb0b-af21-4e12-a010-e7f794c1f05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34609381-4d8e-43a1-9d8a-3626f968d9a2', 'volume_name': 'volume-34609381-4d8e-43a1-9d8a-3626f968d9a2', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bad135f-f1db-496b-b320-8b1953e13dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bad135f-f1db-496b-b320-8b1953e13dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803b51f2-0e1e-48ea-92f0-62e6a9f4c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:19 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Volume 34609381-4d8e-43a1-9d8a-3626f968d9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34609381-4d8e-43a1-9d8a-3626f968d9a2', 'volume_size': 1} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:03:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Flow 'volume_create_manager' (427e234b-a90d-49e3-ba59-5346ecfa9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e961999e-27f2-4c51-91ba-20a155017e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e961999e-27f2-4c51-91ba-20a155017e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1233520870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d7dcc13d7a497f915d8862ba6379a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:20Z,use_quota=True,user_id='518be0849038411fb92ec0fd2f58707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c359482-a215-4078-8e35-dc03c2586964),volume_type_id=7c359482-a215-4078-8e35-dc03c2586964)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd5c131-6ca0-46a0-95a8-63fb58d1b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd5c131-6ca0-46a0-95a8-63fb58d1b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1a83bc-3a3e-471c-8849-cbb14285efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:20 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 1073741824" returned: 0 in 1.203s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:20 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 Jun 24 16:03:20 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1a83bc-3a3e-471c-8849-cbb14285efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3', 'volume_name': 'volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3', 'volume_size': 1, 'image_id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03faeb9e-8fa6-409c-897c-224d3a2e7747', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528345300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '67d7dcc13d7a497f915d8862ba6379a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'created_at': datetime.datetime(2026, 6, 24, 14, 3, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 3, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03faeb9e-8fa6-409c-897c-224d3a2e7747/file', 'properties': {}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab6b925-5829-4b41-bc7a-a85680aa9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab6b925-5829-4b41-bc7a-a85680aa9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9cb5ab-47e5-4af0-aad7-75c9cff23484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:20 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Volume 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3', 'volume_size': 1, 'image_id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03faeb9e-8fa6-409c-897c-224d3a2e7747', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528345300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '67d7dcc13d7a497f915d8862ba6379a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'created_at': datetime.datetime(2026, 6, 24, 14, 3, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 3, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03faeb9e-8fa6-409c-897c-224d3a2e7747/file', 'properties': {}}, 'image_service': } Jun 24 16:03:20 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Trying to clone 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 from image 03faeb9e-8fa6-409c-897c-224d3a2e7747 at location (None, [{'url': 'file:///opt/stack/data/glance/images/03faeb9e-8fa6-409c-897c-224d3a2e7747', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:03:21 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2" returned: 0 in 0.979s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1005526802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34609381-4d8e-43a1-9d8a-3626f968d9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d7dcc13d7a497f915d8862ba6379a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:19Z,use_quota=True,user_id='518be0849038411fb92ec0fd2f58707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea211447-08fb-4f78-935c-14f5178d2b6b),volume_type_id=ea211447-08fb-4f78-935c-14f5178d2b6b)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Creating volume 34609381-4d8e-43a1-9d8a-3626f968d9a2 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:03:21 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3b8c9c-6b3b-4da5-bcba-418f0344990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-322d04e6-685b-4847-9506-c748734f5ba2', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:21 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 1073741824 Jun 24 16:03:21 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46878b8b-4429-42fd-810c-642b649b81ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:21 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Volume volume-322d04e6-685b-4847-9506-c748734f5ba2 (322d04e6-685b-4847-9506-c748734f5ba2): created successfully Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46878b8b-4429-42fd-810c-642b649b81ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Flow 'volume_create_manager' (a0383e79-fee3-4dc4-bd39-631f2c5f8492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b794871a-fbdb-4a72-b807-d025b56c0959 tempest-TestInstancesWithCinderVolumes-183898676 None] Created volume successfully. Jun 24 16:03:22 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 1073741824" returned: 0 in 1.031s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:22 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 Jun 24 16:03:22 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:23 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2" returned: 0 in 0.930s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803b51f2-0e1e-48ea-92f0-62e6a9f4c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34609381-4d8e-43a1-9d8a-3626f968d9a2', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c416da-37e6-41d8-9ec7-11ab2f833ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Volume volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 (34609381-4d8e-43a1-9d8a-3626f968d9a2): created successfully Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c416da-37e6-41d8-9ec7-11ab2f833ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Flow 'volume_create_manager' (a7cffe89-8ecb-48fd-adc4-ea6259e295ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-07596267-cc7d-49d0-9943-91508cfdff72 tempest-TestInstancesWithCinderVolumes-183898676 None] Created volume successfully. Jun 24 16:03:25 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD, size 20.69 MB, duration 4.57 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:03:25 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Image download 20.69 MB at 4.52 MB/s Jun 24 16:03:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d37f23-07f4-46ce-bfcc-34a64071f24d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:25 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD Jun 24 16:03:25 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:25 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-75244474-e4cf-4a99-a90a-da725bdc2dc7 req-9476a12d-757b-458c-be46-e890dcdb4e91 tempest-AttachVolumeTestJSON-551800762 None] Terminate volume connection completed successfully. Jun 24 16:03:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-75244474-e4cf-4a99-a90a-da725bdc2dc7 req-9476a12d-757b-458c-be46-e890dcdb4e91 tempest-AttachVolumeTestJSON-551800762 None] Deleting attachment 9000428a-6576-427c-b937-77a31ca8a7c0. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:03:26 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD" returned: 0 in 1.070s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:26 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Temporary image 03faeb9e-8fa6-409c-897c-224d3a2e7747 is fetched for user 518be0849038411fb92ec0fd2f58707a. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:03:26 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[060dcbe7-3121-4f17-a433-4972d94c9cbe]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:26 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD Jun 24 16:03:26 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:27 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD" returned: 0 in 0.970s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1233520870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d7dcc13d7a497f915d8862ba6379a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:20Z,use_quota=True,user_id='518be0849038411fb92ec0fd2f58707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c359482-a215-4078-8e35-dc03c2586964),volume_type_id=7c359482-a215-4078-8e35-dc03c2586964)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Creating volume 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:03:27 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:03:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:27 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 1073741824 Jun 24 16:03:27 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:28 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 1073741824" returned: 0 in 1.056s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:28 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:03:28 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:29 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 0 in 1.092s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:03:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:29 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Attempting download of 03faeb9e-8fa6-409c-897c-224d3a2e7747 ((None, [{'url': 'file:///opt/stack/data/glance/images/03faeb9e-8fa6-409c-897c-224d3a2e7747', 'metadata': {}}])) to volume 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:03:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02cd14-3ca2-44f8-8411-d1a858c44dcc]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:29 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2 Jun 24 16:03:29 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:30 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2" returned: 0 in 0.965s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:30 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2 Jun 24 16:03:30 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:31 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2" returned: 1 in 0.977s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03faeb9e-8fa6-409c-897c-224d3a2e7747_qw2u5cg2' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:03:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1656d36-3232-4f40-95fd-65a58d22a600]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:31 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD Jun 24 16:03:31 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Acquiring lock "cinder-65e53444-e527-49d5-bf17-da336166d4a5-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Lock "cinder-65e53444-e527-49d5-bf17-da336166d4a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Acquiring lock "cinder-quobyte-65e53444-e527-49d5-bf17-da336166d4a5" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Lock "cinder-quobyte-65e53444-e527-49d5-bf17-da336166d4a5" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e7690-865a-4d60-a755-fda374152310]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:32 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD" returned: 0 in 0.934s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] 03faeb9e-8fa6-409c-897c-224d3a2e7747 was qcow2, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:03:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:32 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:03:32 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:32 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 Jun 24 16:03:32 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:33 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5" returned: 0 in 0.879s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:33 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5 Jun 24 16:03:33 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:34 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65e53444-e527-49d5-bf17-da336166d4a5" returned: 0 in 0.895s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Lock "cinder-quobyte-65e53444-e527-49d5-bf17-da336166d4a5" released by "delete_volume" :: held 1.839s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Created reservations ['ca798818-8eb7-41d3-89b7-2fec19dd09ae', 'c5492195-347b-4642-a63b-4b3afa0965b5', '25364db1-cac0-411c-818d-adb2f2ec70de', 'a5863b60-9948-4b2a-8a9a-d005b7751f5e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:34 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:03:34 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:34 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 0 in 2.382s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_03faeb9e-8fa6-409c-897c-224d3a2e7747_l_odbrxgdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:03:34 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Converted 112.00 MB image at 46.99 MB/s Jun 24 16:03:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:34 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 1G Jun 24 16:03:34 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:35 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.787s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:35 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:03:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Deleted volume successfully. Jun 24 16:03:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a5b7052a-9f56-4e6e-a94b-9f64ea48b3f0 tempest-VolumesNegativeTest-2073118811 None] Lock "cinder-65e53444-e527-49d5-bf17-da336166d4a5-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:03:35 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 1G" returned: 0 in 0.824s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[331f8d65-a76f-49a7-bfe1-37c7b46601dd]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:35 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:03:35 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:36 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 0 in 0.832s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:36 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:03:36 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Flow 'volume_create_manager' (408cb5ec-cdff-4912-ac27-1c430b8a3d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6863e24c-f49d-4f5e-a22f-a8f1b9d3bd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6863e24c-f49d-4f5e-a22f-a8f1b9d3bd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2002908394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c313b54a-acec-4cb1-a369-c528110d3355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1773dfe17c045cd9fd43545890e65d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:37Z,use_quota=True,user_id='e0d1915e4d634538bfd6709f87240cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77db0e37-799a-47a5-88db-01ab03387711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77db0e37-799a-47a5-88db-01ab03387711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01114a90-1837-4d3f-a2ca-96f7f4ff730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01114a90-1837-4d3f-a2ca-96f7f4ff730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c313b54a-acec-4cb1-a369-c528110d3355', 'volume_name': 'volume-c313b54a-acec-4cb1-a369-c528110d3355', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:37 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b0ed78-59b3-42d4-9851-54d843eba40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b0ed78-59b3-42d4-9851-54d843eba40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5db155-7992-48d8-b944-b38b4f0803cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Volume c313b54a-acec-4cb1-a369-c528110d3355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c313b54a-acec-4cb1-a369-c528110d3355', 'volume_size': 1} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2002908394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c313b54a-acec-4cb1-a369-c528110d3355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1773dfe17c045cd9fd43545890e65d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:37Z,use_quota=True,user_id='e0d1915e4d634538bfd6709f87240cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Creating volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:03:37 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 1 in 0.835s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Downloaded image 03faeb9e-8fa6-409c-897c-224d3a2e7747 ((None, [{'url': 'file:///opt/stack/data/glance/images/03faeb9e-8fa6-409c-897c-224d3a2e7747', 'metadata': {}}])) to volume 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Temporary image 03faeb9e-8fa6-409c-897c-224d3a2e7747 for user 518be0849038411fb92ec0fd2f58707a is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Marking volume 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:03:37 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 1073741824 Jun 24 16:03:37 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Copying metadata from image 03faeb9e-8fa6-409c-897c-224d3a2e7747 to 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Creating volume glance metadata for volume 383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 backed by image 03faeb9e-8fa6-409c-897c-224d3a2e7747 with: {'image_id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'image_name': 'tempest-scenario-img--528345300', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9cb5ab-47e5-4af0-aad7-75c9cff23484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3', 'volume_size': 1, 'image_id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03faeb9e-8fa6-409c-897c-224d3a2e7747', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528345300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '67d7dcc13d7a497f915d8862ba6379a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03faeb9e-8fa6-409c-897c-224d3a2e7747', 'created_at': datetime.datetime(2026, 6, 24, 14, 3, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 3, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03faeb9e-8fa6-409c-897c-224d3a2e7747/file', 'properties': {}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1baf8590-5c50-4777-8ac8-1f0ad2f202b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Volume volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 (383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3): created successfully Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1baf8590-5c50-4777-8ac8-1f0ad2f202b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Flow 'volume_create_manager' (427e234b-a90d-49e3-ba59-5346ecfa9b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-83acb197-955e-4637-ac94-6ef8c0d8ce2a tempest-TestInstancesWithCinderVolumes-183898676 None] Created volume successfully. Jun 24 16:03:38 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 1073741824" returned: 0 in 0.859s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:38 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 Jun 24 16:03:38 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:38 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5db155-7992-48d8-b944-b38b4f0803cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c313b54a-acec-4cb1-a369-c528110d3355', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3844f9b5-6291-48cf-93fe-44f8d1b2d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:38 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Volume volume-c313b54a-acec-4cb1-a369-c528110d3355 (c313b54a-acec-4cb1-a369-c528110d3355): created successfully Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3844f9b5-6291-48cf-93fe-44f8d1b2d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Flow 'volume_create_manager' (408cb5ec-cdff-4912-ac27-1c430b8a3d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:38 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a4c93b69-a5f4-4de2-bfc7-d1897f3912a2 tempest-VolumesSnapshotListTestJSON-384960657 None] Created volume successfully. Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:39 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:03:39 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Creating offline snapshot 0a101af1-d06b-419a-a43d-06ed04b1ff9b of volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f147775-19dc-47f8-a615-2fc277cdacba]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:39 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 Jun 24 16:03:39 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:40 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.351s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:03:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:03:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:03:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:03:41 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355" returned: 0 in 1.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:41 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b 1G Jun 24 16:03:41 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:42 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b 1G" returned: 0 in 1.073s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:42 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:03:42 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:43 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 0.804s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:43 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b is being set with open permissions: ugo+rw Jun 24 16:03:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:43 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:03:43 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:44 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:44 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info Jun 24 16:03:44 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:44 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info" returned: 0 in 0.673s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:44 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info is being set with open permissions: ugo+rw Jun 24 16:03:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:44 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info Jun 24 16:03:44 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:45 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.info" returned: 0 in 0.726s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.990s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:45 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4282ecbc-35f3-4a3c-bd68-291cc1fe4112 tempest-VolumesSnapshotListTestJSON-384960657 None] Create snapshot completed successfully Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Creating offline snapshot 76061b52-9eee-4274-820e-c257cf2328a6 of volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f57222-294b-40af-8566-33908eec4c49]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Flow 'volume_create_manager' (a9ea01e2-e4ee-4d05-aed5-4d06be732be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3f36cf-d41d-4630-a140-ce649fdde03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3f36cf-d41d-4630-a140-ce649fdde03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722810260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b3be09-caeb-4538-abd5-d605fd1a17dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692bd155bf4f428f9b6712342bba8e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:47Z,use_quota=True,user_id='b5906a21253d42e7a86a54b060169b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2541464-90bc-43cb-8e94-f553516ad55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2541464-90bc-43cb-8e94-f553516ad55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f377da3a-31da-4047-a758-c9afb5146657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f377da3a-31da-4047-a758-c9afb5146657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b3be09-caeb-4538-abd5-d605fd1a17dd', 'volume_name': 'volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5c5771-5f31-403d-86fb-b6455bcf8113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5c5771-5f31-403d-86fb-b6455bcf8113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71412b29-82be-4645-86a4-f5d656e1e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:46 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Volume f5b3be09-caeb-4538-abd5-d605fd1a17dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd', 'volume_size': 1} Jun 24 16:03:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:46 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:03:46 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:47 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 0.974s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:03:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:47 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 1G Jun 24 16:03:47 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:48 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 1G" returned: 0 in 1.056s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:48 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:03:48 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:49 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:49 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 is being set with open permissions: ugo+rw Jun 24 16:03:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:49 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:03:49 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:50 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 0.687s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.613s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722810260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b3be09-caeb-4538-abd5-d605fd1a17dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='692bd155bf4f428f9b6712342bba8e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:03:47Z,use_quota=True,user_id='b5906a21253d42e7a86a54b060169b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Creating volume f5b3be09-caeb-4538-abd5-d605fd1a17dd {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:03:50 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:03:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:50 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd 1073741824 Jun 24 16:03:50 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:50 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-30bb2198-77fb-4c3e-ad80-d47954c43d96 tempest-VolumesSnapshotListTestJSON-384960657 None] Create snapshot completed successfully Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:51 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd 1073741824" returned: 0 in 1.011s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:51 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd Jun 24 16:03:51 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:51 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd" returned: 0 in 0.701s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.860s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71412b29-82be-4645-86a4-f5d656e1e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa691499-338b-4623-a736-8d6829f3493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:03:51 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Volume volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd (f5b3be09-caeb-4538-abd5-d605fd1a17dd): created successfully Jun 24 16:03:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa691499-338b-4623-a736-8d6829f3493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:03:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Flow 'volume_create_manager' (a9ea01e2-e4ee-4d05-aed5-4d06be732be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:03:52 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[624610ec-2f73-480f-bea4-9c426b835d14]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-20d00074-fc0d-4636-aa36-404992851e00 tempest-AttachVolumeNegativeTest-428975072 None] Created volume successfully. Jun 24 16:03:52 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:03:52 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:52 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:52 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:03:52 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:53 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 1 in 0.848s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.666s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.613s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Creating offline snapshot 9ce87470-0ade-4bd4-a5a9-5f85c442f377 of volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[63accd66-d986-4cf1-a082-c9013058606e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd17ede8b-1800-472c-bed1-ec422ff4567f', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:03:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-0decc18f-f261-40e0-9fb2-39b41684fff0 req-f4d62683-855b-4467-8609-481ed5d524d5 tempest-TestInstancesWithCinderVolumes-183898676 None] attachment_update completed successfully. Jun 24 16:03:53 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:03:53 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:54 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 0.776s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:03:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:54 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 1G Jun 24 16:03:54 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:55 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 1G" returned: 0 in 0.949s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:55 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 Jun 24 16:03:55 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:03:56 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:56 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 is being set with open permissions: ugo+rw Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:56 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 Jun 24 16:03:56 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:56 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377" returned: 0 in 0.642s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.218s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.881s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5910ad35-d734-42ab-bd5d-1db88eb52921]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:56 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8151bb68-9ba2-4f89-8729-ab9e5fcf7564 tempest-VolumesSnapshotListTestJSON-384960657 None] Create snapshot completed successfully Jun 24 16:03:56 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd Jun 24 16:03:56 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:57 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd" returned: 0 in 0.810s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:03:57 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '420b384a-72ff-4060-b5b8-e8a81dded0ea', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:03:57 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-8928c0c3-bc10-42fb-9ca3-0f6dc5eede4f req-71d557d8-5d58-4e9f-a03d-cf32e93610f0 tempest-AttachVolumeNegativeTest-428975072 None] attachment_update completed successfully. Jun 24 16:03:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-9ce87470-0ade-4bd4-a5a9-5f85c442f377-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-9ce87470-0ade-4bd4-a5a9-5f85c442f377-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-9ce87470-0ade-4bd4-a5a9-5f85c442f377" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-9ce87470-0ade-4bd4-a5a9-5f85c442f377" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Deleting offline snapshot 9ce87470-0ade-4bd4-a5a9-5f85c442f377 of volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] snapshot_file for this snap is: volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb4e50d-5eef-4660-b99e-2e59246b21a8]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:58 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 Jun 24 16:03:58 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:58 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377" returned: 0 in 0.788s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb25284-e834-446e-be44-95e67bf99f0a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:03:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:59 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:03:59 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:03:59 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jun 24 16:03:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 0.970s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:03:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:03:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:03:59 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 Jun 24 16:03:59 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:01 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377" returned: 0 in 1.418s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:01 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377 Jun 24 16:04:01 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:02 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.9ce87470-0ade-4bd4-a5a9-5f85c442f377" returned: 0 in 1.098s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-9ce87470-0ade-4bd4-a5a9-5f85c442f377" released by "_delete_snapshot" :: held 4.429s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" released by "delete_snapshot" :: held 4.463s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:02 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Created reservations ['65341bfa-3a6f-4ed3-95ea-8effd75e487c', '60ee8568-e947-4c7a-99da-a57a3ae3fa49', '10868fbe-4d25-4b00-ad70-543914368197', 'fa81cf93-6c88-487b-ba41-ca147f4b09d3'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Delete snapshot completed successfully. Jun 24 16:04:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f5d1bdb0-a7a6-4e3b-8939-1ad4c961198a tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-9ce87470-0ade-4bd4-a5a9-5f85c442f377-delete_snapshot" released by "delete_snapshot" :: held 4.659s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-76061b52-9eee-4274-820e-c257cf2328a6-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-76061b52-9eee-4274-820e-c257cf2328a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" acquired by "delete_snapshot" :: waited 0.072s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-76061b52-9eee-4274-820e-c257cf2328a6" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-76061b52-9eee-4274-820e-c257cf2328a6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Deleting offline snapshot 76061b52-9eee-4274-820e-c257cf2328a6 of volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] snapshot_file for this snap is: volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6119f621-0cf8-4437-bc50-aa7b1b5b55bc]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:03 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:04:03 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:04 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-24e7762c-934c-4f48-bdb2-59ce7d536040 req-4297fb43-dfd1-4874-aa13-bc575b457528 tempest-AttachVolumeNegativeTest-428975072 None] Terminate volume connection completed successfully. Jun 24 16:04:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-24e7762c-934c-4f48-bdb2-59ce7d536040 req-4297fb43-dfd1-4874-aa13-bc575b457528 tempest-AttachVolumeNegativeTest-428975072 None] Deleting attachment 420b384a-72ff-4060-b5b8-e8a81dded0ea. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:04:04 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 1.186s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:04:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b6a21c-8ca6-414f-9677-052d493fed79]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:04 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:04:04 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:06 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 1.359s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:04:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:06 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:04:06 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:07 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 1.625s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:07 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6 Jun 24 16:04:07 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:08 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.76061b52-9eee-4274-820e-c257cf2328a6" returned: 0 in 1.232s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-76061b52-9eee-4274-820e-c257cf2328a6" released by "_delete_snapshot" :: held 5.553s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" released by "delete_snapshot" :: held 5.606s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Created reservations ['3affb27f-647f-42d8-a498-96d57105cff9', 'a3f2f3e2-d157-429f-b08e-f90a9781172f', '1222fe01-00c6-4290-abe0-12beae83242b', '4a3f5710-5ef1-4052-9a3a-c8b9cd61da8e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Delete snapshot completed successfully. Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d741cc11-235a-47f0-a114-11134d7b7dd0 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-76061b52-9eee-4274-820e-c257cf2328a6-delete_snapshot" released by "delete_snapshot" :: held 5.900s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-0a101af1-d06b-419a-a43d-06ed04b1ff9b-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-0a101af1-d06b-419a-a43d-06ed04b1ff9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-0a101af1-d06b-419a-a43d-06ed04b1ff9b" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-0a101af1-d06b-419a-a43d-06ed04b1ff9b" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Deleting offline snapshot 0a101af1-d06b-419a-a43d-06ed04b1ff9b of volume c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:04:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] snapshot_file for this snap is: volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:04:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e2e58-b43f-46c8-a104-f41d35e46523]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:10 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:04:10 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:11 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 1.213s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c313b54a-acec-4cb1-a369-c528110d3355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:04:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f6b497-adf2-4955-a805-14ba535e8f6d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:11 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 Jun 24 16:04:11 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:12 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355" returned: 0 in 1.201s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:12 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:04:12 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:13 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 1.302s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:13 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b Jun 24 16:04:13 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:14 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355.0a101af1-d06b-419a-a43d-06ed04b1ff9b" returned: 0 in 1.064s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-0a101af1-d06b-419a-a43d-06ed04b1ff9b" released by "_delete_snapshot" :: held 4.988s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" released by "delete_snapshot" :: held 5.059s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Created reservations ['09145216-aa24-488c-96e0-35aa0d86d067', '78ec119f-2641-4b5d-a463-f9623486fe91', 'd13dd034-d4ea-490a-a432-6941d62bf0a6', '6bb12afc-a525-4c75-83fa-5aa50fd4c9a9'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:15 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Delete snapshot completed successfully. Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-13c45b54-f5fe-4319-a786-230edf882fe3 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-0a101af1-d06b-419a-a43d-06ed04b1ff9b-delete_snapshot" released by "delete_snapshot" :: held 5.348s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-c313b54a-acec-4cb1-a369-c528110d3355-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-c313b54a-acec-4cb1-a369-c528110d3355-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da06b8e-8f71-4057-89e9-75005ef50a8f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:15 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 Jun 24 16:04:15 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:16 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:16 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355 Jun 24 16:04:16 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:17 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c313b54a-acec-4cb1-a369-c528110d3355" returned: 0 in 1.076s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-quobyte-c313b54a-acec-4cb1-a369-c528110d3355" released by "delete_volume" :: held 1.968s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=66,cinder:UPDATE=47,cinder:INSERT=13,cinder:DELETE=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=50,cinder:SELECT=52,cinder:INSERT=18,cinder:DELETE=4 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Created reservations ['40b58cbb-cbef-4a25-a838-0179cadfca95', '3d839ded-819f-42e1-b37e-dcc60ed12c3b', '2438686c-818c-4e96-a417-663a9fa54611', '1460ba86-cc2e-4804-b2a6-2bbfc1c5376e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:18 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:04:18 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "cinder-f5b3be09-caeb-4538-abd5-d605fd1a17dd-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-f5b3be09-caeb-4538-abd5-d605fd1a17dd-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "cinder-quobyte-f5b3be09-caeb-4538-abd5-d605fd1a17dd" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-quobyte-f5b3be09-caeb-4538-abd5-d605fd1a17dd" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e4a94-40f4-4e70-b240-8a7e92ec8ae5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:18 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd Jun 24 16:04:18 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:18 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.843s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:04:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Deleted volume successfully. Jun 24 16:04:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5761058a-bdd5-4001-9e14-b9f87173b192 tempest-VolumesSnapshotListTestJSON-384960657 None] Lock "cinder-c313b54a-acec-4cb1-a369-c528110d3355-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:19 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd" returned: 0 in 0.860s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:19 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd Jun 24 16:04:19 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:19 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f5b3be09-caeb-4538-abd5-d605fd1a17dd" returned: 0 in 0.754s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-quobyte-f5b3be09-caeb-4538-abd5-d605fd1a17dd" released by "delete_volume" :: held 1.665s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Created reservations ['df685105-d2a5-4d96-b110-5a1013e0fc22', '9963d48c-4709-45f0-8feb-3019b45b8b67', '96a63cdc-064a-484e-80b8-05bea95395df', '8b792cb0-2175-4e51-9b42-8ca422b534f5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:19 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:04:19 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "cinder-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "cinder-quobyte-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-quobyte-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[807f0a9f-1c61-414e-912c-54bad16b20bb]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:20 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb Jun 24 16:04:20 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:20 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.803s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:04:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Deleted volume successfully. Jun 24 16:04:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9d09dff7-653c-45b6-a0a4-404453c003e0 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-f5b3be09-caeb-4538-abd5-d605fd1a17dd-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:21 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" returned: 0 in 0.807s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:21 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb Jun 24 16:04:21 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:22 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-quobyte-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb" released by "delete_volume" :: held 1.531s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Created reservations ['f0a305c4-e0a6-4b08-afd9-1018496ad333', '34768f3c-e917-4d41-b279-8c655cdba9c3', 'c63b75bd-88cd-4527-871f-e7d7ead19c04', '2b8a0062-22d5-4a7d-ae2d-ec1785e5c255'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:22 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:04:22 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "cinder-9d127fa3-f850-406a-9571-18f02f8da2bc-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-9d127fa3-f850-406a-9571-18f02f8da2bc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "cinder-quobyte-9d127fa3-f850-406a-9571-18f02f8da2bc" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-quobyte-9d127fa3-f850-406a-9571-18f02f8da2bc" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09fead6-d830-46cf-adc0-a37e04876a6e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:23 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.024s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:04:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Deleted volume successfully. Jun 24 16:04:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dfb9b142-af46-49fa-a5e3-229124523910 tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-3d8ffbd1-4a31-44c6-9e29-7359c5704ffb-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:23 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc Jun 24 16:04:23 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:24 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc" returned: 0 in 0.998s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:24 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc Jun 24 16:04:24 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:24 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d127fa3-f850-406a-9571-18f02f8da2bc" returned: 0 in 0.766s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-quobyte-9d127fa3-f850-406a-9571-18f02f8da2bc" released by "delete_volume" :: held 1.820s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:24 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Created reservations ['d9c090c1-4567-49b2-9c23-dff780364c57', '795a4a8b-018b-4a0d-8342-52a1f8f67213', 'bc5f1a45-875c-4f61-aa37-a3af53ce4eed', '1960ea1e-779a-4311-95e9-cd85af127c3a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:25 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:04:25 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:25 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.774s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:04:25 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Deleted volume successfully. Jun 24 16:04:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-3074908a-93c8-4c54-9491-2204b9783dec tempest-AttachVolumeNegativeTest-428975072 None] Lock "cinder-9d127fa3-f850-406a-9571-18f02f8da2bc-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487562d-b8c2-49f4-979f-fb90cf3f243f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:32 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 Jun 24 16:04:32 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:33 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2" returned: 0 in 0.984s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-322d04e6-685b-4847-9506-c748734f5ba2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16170b5d-c282-4860-8ad2-0baebf597fa6', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:04:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-6a69f1f3-805a-4a24-8d39-a7939a441372 req-7c41f68a-e77a-47de-bfaa-84a0d58bcc56 tempest-TestInstancesWithCinderVolumes-183898676 None] attachment_update completed successfully. Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:39 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:04:39 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:40 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.873s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:04:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:04:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:04:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:04:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:41 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f55610a-2f94-469f-b774-d6f146af59cf]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:42 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 Jun 24 16:04:42 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:42 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2" returned: 0 in 0.961s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.979s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-34609381-4d8e-43a1-9d8a-3626f968d9a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2764b55-4d02-4545-9fb9-9a688827c687', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:04:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-c7f25e8d-03ea-4a54-9f45-798a02f41b8a req-31f95042-9809-4844-bb9d-fb0686eb5adb tempest-TestInstancesWithCinderVolumes-183898676 None] attachment_update completed successfully. Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Flow 'volume_create_manager' (9f21bbb2-2a70-4087-9bf0-3e229256e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1769963-877d-4fc5-ac10-f42e4d24cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1769963-877d-4fc5-ac10-f42e4d24cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1336489787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31853497-b00c-4002-b45b-1c81ddb2a5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83129325e42a4bf3b3f3b5573281aca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:04:44Z,use_quota=True,user_id='3092b306d57647b0ad74e882d7982ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9a023d-2227-42ea-9910-637335faa9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9a023d-2227-42ea-9910-637335faa9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2551b315-7dcb-44a9-8d36-aed523516aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2551b315-7dcb-44a9-8d36-aed523516aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31853497-b00c-4002-b45b-1c81ddb2a5df', 'volume_name': 'volume-31853497-b00c-4002-b45b-1c81ddb2a5df', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b10c81e-587d-44c7-97e4-93c9b892e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b10c81e-587d-44c7-97e4-93c9b892e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527578ef-2c98-48a3-92d5-b6eaa1b60ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:44 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Volume 31853497-b00c-4002-b45b-1c81ddb2a5df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31853497-b00c-4002-b45b-1c81ddb2a5df', 'volume_size': 1} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1336489787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31853497-b00c-4002-b45b-1c81ddb2a5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83129325e42a4bf3b3f3b5573281aca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:04:44Z,use_quota=True,user_id='3092b306d57647b0ad74e882d7982ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Creating volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:04:44 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:04:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:44 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df 1073741824 Jun 24 16:04:44 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:45 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df 1073741824" returned: 0 in 1.098s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:45 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df Jun 24 16:04:45 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:46 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df" returned: 0 in 0.855s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527578ef-2c98-48a3-92d5-b6eaa1b60ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31853497-b00c-4002-b45b-1c81ddb2a5df', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcc8d13-c22f-47ec-9599-05a812fe4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:46 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Volume volume-31853497-b00c-4002-b45b-1c81ddb2a5df (31853497-b00c-4002-b45b-1c81ddb2a5df): created successfully Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcc8d13-c22f-47ec-9599-05a812fe4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Flow 'volume_create_manager' (9f21bbb2-2a70-4087-9bf0-3e229256e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:04:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-30cbb6d6-7746-4c11-a29e-fd5eaa103c53 tempest-SnapshotsActionsTest-956287705 None] Created volume successfully. Jun 24 16:04:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Creating offline snapshot ce701268-3316-4d54-b94e-b5b3d2f9b0e2 of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:04:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04641b-ad97-486f-8730-cfa848cf9075]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:48 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df Jun 24 16:04:48 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:49 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df" returned: 0 in 1.459s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:49 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 1G Jun 24 16:04:49 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:50 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 1G" returned: 0 in 1.445s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:51 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:04:51 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Flow 'volume_create_manager' (121762a5-8b13-408a-9bfe-ad4395e882bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:04:52 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb22dfb4-9c3a-4f4a-83e2-61caebde82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 1.328s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:52 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 is being set with open permissions: ugo+rw Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb22dfb4-9c3a-4f4a-83e2-61caebde82cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1187373342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2534907a-880e-41aa-91ae-94b7f3587dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cbf68ae2cd44d4b4ffa91c179aa42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:04:52Z,use_quota=True,user_id='f51034a30122494ca3b28a22c65c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf38cddc-f504-4777-b487-17a75fd110ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:52 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf38cddc-f504-4777-b487-17a75fd110ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:52 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf144c62-6d75-4bd0-a301-d2059169a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf144c62-6d75-4bd0-a301-d2059169a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2534907a-880e-41aa-91ae-94b7f3587dd1', 'volume_name': 'volume-2534907a-880e-41aa-91ae-94b7f3587dd1', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e8efc-27f2-4323-b6c2-cb86b70ee0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e8efc-27f2-4323-b6c2-cb86b70ee0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b93dd9-01bb-4da3-858b-cfdd09baef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:04:52 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Volume 2534907a-880e-41aa-91ae-94b7f3587dd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2534907a-880e-41aa-91ae-94b7f3587dd1', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 16:04:52 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Trying to clone 2534907a-880e-41aa-91ae-94b7f3587dd1 from image cec30253-e3a4-40e1-82d3-11c0f2e0458f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:04:53 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.927s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:53 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info Jun 24 16:04:53 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:53 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:04:53 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Image download 20.69 MB at 20.69 MB/s Jun 24 16:04:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6db1e12-186b-4bf3-90bd-e59b382d3a98]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:53 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD Jun 24 16:04:53 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:53 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info" returned: 0 in 0.692s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:54 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info is being set with open permissions: ugo+rw Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:54 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info Jun 24 16:04:54 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:54 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f is fetched for user f51034a30122494ca3b28a22c65c153b. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade9e94-4bf3-4ee8-9295-03e12eb7ac2e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:54 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD Jun 24 16:04:54 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:54 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-cd2cd74f-2a29-4183-a936-1fdd736a4453 req-3b071c0c-71cf-4422-8578-5a0c24507e7b tempest-TestInstancesWithCinderVolumes-183898676 None] Terminate volume connection completed successfully. Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-cd2cd74f-2a29-4183-a936-1fdd736a4453 req-3b071c0c-71cf-4422-8578-5a0c24507e7b tempest-TestInstancesWithCinderVolumes-183898676 None] Deleting attachment 16170b5d-c282-4860-8ad2-0baebf597fa6. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:04:54 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.info" returned: 0 in 0.829s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.848s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:54 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-cf959218-b84c-49ea-8ec7-b4915cef5e1b tempest-SnapshotsActionsTest-956287705 None] Create snapshot completed successfully Jun 24 16:04:55 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1187373342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2534907a-880e-41aa-91ae-94b7f3587dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48cbf68ae2cd44d4b4ffa91c179aa42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:04:52Z,use_quota=True,user_id='f51034a30122494ca3b28a22c65c153b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Creating volume 2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:04:55 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:04:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:55 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 1073741824 Jun 24 16:04:55 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:56 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 1073741824" returned: 0 in 0.906s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:56 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:04:56 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "cinder-322d04e6-685b-4847-9506-c748734f5ba2-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-322d04e6-685b-4847-9506-c748734f5ba2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "cinder-quobyte-322d04e6-685b-4847-9506-c748734f5ba2" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-quobyte-322d04e6-685b-4847-9506-c748734f5ba2" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe99a1e-ea7e-4a5e-a179-58ec6313b4e0]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:56 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 Jun 24 16:04:56 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:56 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 0.677s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.789s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:56 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Creating offline snapshot 2e29eed8-6a72-49c1-8daf-a169ecf85b7a of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Attempting download of cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume 2534907a-880e-41aa-91ae-94b7f3587dd1. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb030cc-8a84-4474-90ee-300ac3a858bd]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[82702fab-ebf6-4b6f-804d-cb485a8db296]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:57 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:04:57 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:57 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8 Jun 24 16:04:57 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:57 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2" returned: 0 in 1.042s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:57 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2 Jun 24 16:04:57 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:58 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 1.141s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:58 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a 1G Jun 24 16:04:58 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:58 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8" returned: 0 in 1.302s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:58 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8 Jun 24 16:04:58 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:58 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-322d04e6-685b-4847-9506-c748734f5ba2" returned: 0 in 1.129s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-quobyte-322d04e6-685b-4847-9506-c748734f5ba2" released by "delete_volume" :: held 2.240s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:04:58 devstack cinder-volume[93867]: WARNING cinder.quota [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586419056-911436659 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586419056-911436659, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:04:58 devstack cinder-volume[93867]: WARNING cinder.quota [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586419056-911436659 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1586419056-911436659, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:04:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Created reservations ['b3b33934-7c1b-4df3-a51a-b34eb8954585', '725bf889-1de5-43d0-ade6-9ed1c4e8fbb0', '608aeeb0-ed10-488a-b929-00d703adbd48', 'aa82ebb4-0c8e-4e04-a5ed-1eb241175105'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:59 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:04:59 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:59 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a 1G" returned: 0 in 1.262s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:59 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a Jun 24 16:04:59 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:59 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8" returned: 1 in 1.128s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_3t4618k8' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e6349e-b69b-4784-9ed4-165a068e3964]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:04:59 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD Jun 24 16:04:59 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:04:59 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.823s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:04:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Deleted volume successfully. Jun 24 16:04:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a154061a-fb1f-4a1c-9435-c1ad76d51940 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-322d04e6-685b-4847-9506-c748734f5ba2-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:00 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a" returned: 0 in 0.868s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:00 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a is being set with open permissions: ugo+rw Jun 24 16:05:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:00 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a Jun 24 16:05:00 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:00 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:00 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] cec30253-e3a4-40e1-82d3-11c0f2e0458f was qcow2, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:05:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:00 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:05:00 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:01 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a" returned: 0 in 0.695s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.119s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:01 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-653a5d63-11fb-43cc-a228-e2a842f2d176 tempest-SnapshotsActionsTest-956287705 None] Create snapshot completed successfully Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-2e29eed8-6a72-49c1-8daf-a169ecf85b7a-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-2e29eed8-6a72-49c1-8daf-a169ecf85b7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-2e29eed8-6a72-49c1-8daf-a169ecf85b7a" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-2e29eed8-6a72-49c1-8daf-a169ecf85b7a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Deleting offline snapshot 2e29eed8-6a72-49c1-8daf-a169ecf85b7a of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] snapshot_file for this snap is: volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde4d046-9b75-4fcf-9d7d-e1ed6d676c0d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:01 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a Jun 24 16:05:01 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-0128a791-bf6a-4f83-a1a1-8b56acb14999 req-06c0a8bc-6940-4830-af0b-2ce704b96574 tempest-TestInstancesWithCinderVolumes-183898676 None] Terminate volume connection completed successfully. Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-0128a791-bf6a-4f83-a1a1-8b56acb14999 req-06c0a8bc-6940-4830-af0b-2ce704b96574 tempest-TestInstancesWithCinderVolumes-183898676 None] Deleting attachment b2764b55-4d02-4545-9fb9-9a688827c687. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:05:02 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a" returned: 0 in 0.891s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c1dd6e-2738-4918-89ef-1f951dae62b3]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:02 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 2.122s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_jzejxytzdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:05:02 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Converted 112.00 MB image at 52.72 MB/s Jun 24 16:05:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:02 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 1G Jun 24 16:05:02 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:02 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:02 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:03 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 1G" returned: 0 in 0.726s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:03 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf58b6c-baf8-4ed6-8823-e97ed795a9b1]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:03 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.822s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:03 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a Jun 24 16:05:03 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:03 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:05:03 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "cinder-34609381-4d8e-43a1-9d8a-3626f968d9a2-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-34609381-4d8e-43a1-9d8a-3626f968d9a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "cinder-quobyte-34609381-4d8e-43a1-9d8a-3626f968d9a2" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:04 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-quobyte-34609381-4d8e-43a1-9d8a-3626f968d9a2" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 0.813s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51fe7b8-085a-49cf-8b91-d3ee6eb00fe6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:04 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:05:04 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:04 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 Jun 24 16:05:04 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:04 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a" returned: 0 in 0.938s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:04 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a Jun 24 16:05:04 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:05 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 1 in 0.902s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Downloaded image cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume 2534907a-880e-41aa-91ae-94b7f3587dd1 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:05:05 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f for user f51034a30122494ca3b28a22c65c153b is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Marking volume 2534907a-880e-41aa-91ae-94b7f3587dd1 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:05:05 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2" returned: 0 in 0.912s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.2e29eed8-6a72-49c1-8daf-a169ecf85b7a" returned: 0 in 0.760s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:05 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2 Jun 24 16:05:05 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-2e29eed8-6a72-49c1-8daf-a169ecf85b7a" released by "_delete_snapshot" :: held 3.551s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Copying metadata from image cec30253-e3a4-40e1-82d3-11c0f2e0458f to 2534907a-880e-41aa-91ae-94b7f3587dd1. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Creating volume glance metadata for volume 2534907a-880e-41aa-91ae-94b7f3587dd1 backed by image cec30253-e3a4-40e1-82d3-11c0f2e0458f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" released by "delete_snapshot" :: held 3.593s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Created reservations ['11183b88-af14-4e25-a1bb-b5965ad1a6ba', '73af5db3-35bb-4234-974d-32401049c88f', '40b76f89-558f-45d4-9cb0-d17d6085cfd8', '59d394f5-4b53-4f97-9e70-c802c028c0b4'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b93dd9-01bb-4da3-858b-cfdd09baef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2534907a-880e-41aa-91ae-94b7f3587dd1', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909ee56f-0c51-4dd4-9ae9-65ea19c6a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Volume volume-2534907a-880e-41aa-91ae-94b7f3587dd1 (2534907a-880e-41aa-91ae-94b7f3587dd1): created successfully Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909ee56f-0c51-4dd4-9ae9-65ea19c6a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Flow 'volume_create_manager' (121762a5-8b13-408a-9bfe-ad4395e882bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:05:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-22579765-f3bd-47ee-95ad-84542f6b31f5 tempest-TestShelveInstance-267595778 None] Created volume successfully. Jun 24 16:05:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Delete snapshot completed successfully. Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de932440-1985-4fe6-917e-5832c5ce8f29 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-2e29eed8-6a72-49c1-8daf-a169ecf85b7a-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:05 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-34609381-4d8e-43a1-9d8a-3626f968d9a2" returned: 0 in 0.777s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-quobyte-34609381-4d8e-43a1-9d8a-3626f968d9a2" released by "delete_volume" :: held 1.761s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:05 devstack cinder-volume[93867]: WARNING cinder.quota [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-19687762-932813925 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-19687762-932813925, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:05:05 devstack cinder-volume[93867]: WARNING cinder.quota [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-19687762-932813925 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-19687762-932813925, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Created reservations ['c3c5a2b7-e5ac-4725-907b-5c9f89f7fa82', '18d219c3-5fcc-4e9a-821b-fe152b12acca', 'bf2f97fa-02a0-4428-9185-1ce5a8d8589c', '2d5adc66-df10-40f3-b720-93f36df93d4c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:06 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:05:06 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Creating offline snapshot ae6b7adb-5490-405a-a3c6-0e97abb95986 of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[62152515-d14a-4e9b-bd64-ab7a0bf287d5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:06 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:06 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:07 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.995s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:07 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:05:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Deleted volume successfully. Jun 24 16:05:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-26ebf886-89dc-4b8e-8a6d-a83380d59899 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-34609381-4d8e-43a1-9d8a-3626f968d9a2-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:07 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 1.188s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:07 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 1G Jun 24 16:05:07 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:08 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 1G" returned: 0 in 1.069s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:08 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 Jun 24 16:05:08 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:09 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986" returned: 0 in 0.975s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:09 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 is being set with open permissions: ugo+rw Jun 24 16:05:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:09 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 Jun 24 16:05:09 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:10 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986" returned: 0 in 0.769s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:10 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4485994e-c224-4647-8819-abad1ff76436 tempest-SnapshotsActionsTest-956287705 None] Create snapshot completed successfully Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-ae6b7adb-5490-405a-a3c6-0e97abb95986-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-ae6b7adb-5490-405a-a3c6-0e97abb95986-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-ae6b7adb-5490-405a-a3c6-0e97abb95986" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-ae6b7adb-5490-405a-a3c6-0e97abb95986" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Deleting offline snapshot ae6b7adb-5490-405a-a3c6-0e97abb95986 of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] snapshot_file for this snap is: volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[14391c49-ba6a-4efb-8032-b1287cb9846a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:10 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 Jun 24 16:05:10 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:11 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986" returned: 0 in 0.926s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f6b6d-4014-435a-a2c4-a50d5d558dd9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Flow 'volume_create_manager' (44b9885a-1e30-4004-83ef-f587c5205fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21412125-11bf-4b7f-9537-473067f404bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21412125-11bf-4b7f-9537-473067f404bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1896712230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d18b0f1-2fdd-4d4c-ace0-8450176b56f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a443d651a77481db998e50d0d22df71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:05:12Z,use_quota=True,user_id='ec218a826a06426eb9fd7169e8bf6ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cebc512-bf24-48dd-9fa9-4b4c4174c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cebc512-bf24-48dd-9fa9-4b4c4174c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ab5203-116a-48d5-9052-29851728df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ab5203-116a-48d5-9052-29851728df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d18b0f1-2fdd-4d4c-ace0-8450176b56f4', 'volume_name': 'volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11fa51e-027d-4903-874f-919082e454f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11fa51e-027d-4903-874f-919082e454f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b856f4f5-c1eb-4fa2-95d1-ce365173614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:11 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Volume 1d18b0f1-2fdd-4d4c-ace0-8450176b56f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4', 'volume_size': 1} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1896712230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d18b0f1-2fdd-4d4c-ace0-8450176b56f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a443d651a77481db998e50d0d22df71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:05:12Z,use_quota=True,user_id='ec218a826a06426eb9fd7169e8bf6ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Creating volume 1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:05:11 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:05:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:11 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:11 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:11 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 1073741824 Jun 24 16:05:11 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:12 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.858s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:12 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 Jun 24 16:05:12 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:12 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-b7dee2c9-50aa-4b64-9c8e-a0fd3f1a218c req-d642752b-ce97-4692-960e-aceb5156b0a9 tempest-TestInstancesWithCinderVolumes-183898676 None] Terminate volume connection completed successfully. Jun 24 16:05:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-b7dee2c9-50aa-4b64-9c8e-a0fd3f1a218c req-d642752b-ce97-4692-960e-aceb5156b0a9 tempest-TestInstancesWithCinderVolumes-183898676 None] Deleting attachment d17ede8b-1800-472c-bed1-ec422ff4567f. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:05:12 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 1073741824" returned: 0 in 0.935s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:12 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 Jun 24 16:05:12 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:13 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986" returned: 0 in 0.884s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:13 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986 Jun 24 16:05:13 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:13 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" returned: 0 in 0.708s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b856f4f5-c1eb-4fa2-95d1-ce365173614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f3054-d03f-4c8a-b6c1-f7c904b2a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:13 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Volume volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 (1d18b0f1-2fdd-4d4c-ace0-8450176b56f4): created successfully Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f3054-d03f-4c8a-b6c1-f7c904b2a671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Flow 'volume_create_manager' (44b9885a-1e30-4004-83ef-f587c5205fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:05:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-377d8084-8051-4635-adb6-a6d54f0be9a0 tempest-AttachVolumeTestJSON-551800762 None] Created volume successfully. Jun 24 16:05:14 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ae6b7adb-5490-405a-a3c6-0e97abb95986" returned: 0 in 0.818s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-ae6b7adb-5490-405a-a3c6-0e97abb95986" released by "_delete_snapshot" :: held 3.608s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" released by "delete_snapshot" :: held 3.632s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:14 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Created reservations ['1ab4f53e-dd3a-4ca1-b49b-a958c68c99d0', 'd5232d26-3c34-48f0-aa66-a7473e86f609', 'c192b0c6-ab22-41f8-bd61-039792e0df1d', '2166760d-b92a-4b29-a0dd-583669810755'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Delete snapshot completed successfully. Jun 24 16:05:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-aa23927e-ba60-48d1-9986-1b27f1b99304 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-ae6b7adb-5490-405a-a3c6-0e97abb95986-delete_snapshot" released by "delete_snapshot" :: held 3.823s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Creating offline snapshot b366b587-b71e-462d-9982-e2fdfd3d6bfd of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:05:15 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4087fbd-2ce2-492b-b380-a9dc882e19d4]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:15 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:15 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "cinder-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "cinder-quobyte-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-quobyte-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3f554-7664-4f08-a7e2-179cdb52df9f]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:16 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.877s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:16 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd 1G Jun 24 16:05:16 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:16 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:05:16 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:17 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 0 in 0.874s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:17 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd 1G" returned: 0 in 0.934s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:17 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:05:17 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:17 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd Jun 24 16:05:17 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:18 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 1 in 0.789s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:18 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3 Jun 24 16:05:18 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:18 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:18 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd is being set with open permissions: ugo+rw Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:18 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd Jun 24 16:05:18 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:18 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" returned: 0 in 0.699s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-quobyte-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3" released by "delete_volume" :: held 2.434s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=86,cinder:INSERT=25,cinder:UPDATE=68,cinder:DELETE=6 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:05:18 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd" returned: 0 in 0.682s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=70,cinder:INSERT=24,cinder:UPDATE=85,cinder:DELETE=6 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.411s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.287s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:18 devstack cinder-volume[93867]: WARNING cinder.quota [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-205508068-1988992826 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-205508068-1988992826, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:05:18 devstack cinder-volume[93867]: WARNING cinder.quota [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-205508068-1988992826 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-205508068-1988992826, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:05:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4dbba5e9-3bfa-480e-b9b6-662198ed6d79 tempest-SnapshotsActionsTest-956287705 None] Create snapshot completed successfully Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[202c858c-fb66-4398-b73e-d65f5f1d440e]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Created reservations ['9b77ec38-0069-48b6-80e2-ccf821eb4429', 'ac1a51fe-4599-49bb-97c1-c0181a77e2f2', 'ec875d6a-74b9-497c-a33c-bc99156ec5e0', '5fa32134-2638-4579-83d5-0f5d21b8e369'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:18 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:05:18 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:18 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:05:18 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:19 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:19 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:05:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Deleted volume successfully. Jun 24 16:05:19 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 0.782s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89c2cf24-d872-4398-b216-8f0d1c51a106 tempest-TestInstancesWithCinderVolumes-183898676 None] Lock "cinder-383f0bcf-a2a5-4edc-bb20-e5f02c9df3e3-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:19 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:05:19 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:20 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 1 in 0.754s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.581s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.348s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af592a9-ef5a-4e3e-a348-78e7b77571ef]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-2534907a-880e-41aa-91ae-94b7f3587dd1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fefd509-f538-4de2-b3eb-bf4bacdfcb79', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:05:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-e5634566-b44e-4114-9ebc-fb30a93db5fe req-cbfcc3f2-9d18-4edc-a16e-5d7ab7921177 tempest-TestShelveInstance-267595778 None] attachment_update completed successfully. Jun 24 16:05:20 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 Jun 24 16:05:20 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:21 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" returned: 0 in 0.775s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd65c15ac-9347-4503-9fee-2bb558e9259b', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:05:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-3d4ddfdf-9910-483a-b4d0-fa42832d175b req-da0be126-088b-48cf-95f7-eee9112ca13d tempest-AttachVolumeTestJSON-551800762 None] attachment_update completed successfully. Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-b366b587-b71e-462d-9982-e2fdfd3d6bfd-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-b366b587-b71e-462d-9982-e2fdfd3d6bfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-b366b587-b71e-462d-9982-e2fdfd3d6bfd" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-b366b587-b71e-462d-9982-e2fdfd3d6bfd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Deleting offline snapshot b366b587-b71e-462d-9982-e2fdfd3d6bfd of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] snapshot_file for this snap is: volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b040f3-9265-4f1e-92e8-229c972500da]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:21 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd Jun 24 16:05:21 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:22 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd" returned: 0 in 0.961s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:22 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41aa79-e91d-413b-989c-c92c6d7e84ff]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:22 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:22 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:23 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.906s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:23 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd Jun 24 16:05:23 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:24 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd" returned: 0 in 0.841s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:24 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd Jun 24 16:05:24 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:24 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.b366b587-b71e-462d-9982-e2fdfd3d6bfd" returned: 0 in 0.771s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-b366b587-b71e-462d-9982-e2fdfd3d6bfd" released by "_delete_snapshot" :: held 3.584s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" released by "delete_snapshot" :: held 3.608s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:25 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Created reservations ['2cae36f0-e966-4b97-ac37-4dc6f41dc277', 'fd8f9064-a895-4e33-b524-8f264d52dbf5', '7cc59566-34a2-4d3c-a42c-d1196bc58a23', 'b12e0a3a-262e-4389-9968-5cb22464e895'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:25 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Delete snapshot completed successfully. Jun 24 16:05:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4eb3b7dd-3fc9-4caf-ae7b-7ec91e117085 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-b366b587-b71e-462d-9982-e2fdfd3d6bfd-delete_snapshot" released by "delete_snapshot" :: held 3.828s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Creating offline snapshot 7710ac58-e1a7-41fc-ab34-88d6d9030760 of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:05:26 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d37543-fd8c-495b-b91e-bb8617dae315]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:26 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:26 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:27 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 1.590s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:27 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 1G Jun 24 16:05:27 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Flow 'volume_create_manager' (4ce13a36-5055-4eac-b43b-fcb7250021c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c408f8a6-c367-48ba-947d-1405ff760f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c408f8a6-c367-48ba-947d-1405ff760f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081039800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bb4596-836e-4e20-973e-d75363cce81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a443d651a77481db998e50d0d22df71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:05:28Z,use_quota=True,user_id='ec218a826a06426eb9fd7169e8bf6ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b61ba15-a804-4ddb-b538-7a0d861a5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b61ba15-a804-4ddb-b538-7a0d861a5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e654533-8763-48a1-bc64-baae1a3598e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e654533-8763-48a1-bc64-baae1a3598e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bb4596-836e-4e20-973e-d75363cce81e', 'volume_name': 'volume-b4bb4596-836e-4e20-973e-d75363cce81e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6ed833-409f-4a35-b1a3-552b0424e353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6ed833-409f-4a35-b1a3-552b0424e353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c56df51-6ae6-4946-a987-72960ad9dd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Volume b4bb4596-836e-4e20-973e-d75363cce81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bb4596-836e-4e20-973e-d75363cce81e', 'volume_size': 1} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:28 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 1G" returned: 0 in 1.130s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:28 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 Jun 24 16:05:28 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:29 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760" returned: 0 in 0.962s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:29 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 is being set with open permissions: ugo+rw Jun 24 16:05:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:29 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 Jun 24 16:05:29 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:30 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760" returned: 0 in 0.913s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.735s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.491s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2081039800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bb4596-836e-4e20-973e-d75363cce81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a443d651a77481db998e50d0d22df71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:05:28Z,use_quota=True,user_id='ec218a826a06426eb9fd7169e8bf6ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Creating volume b4bb4596-836e-4e20-973e-d75363cce81e {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:05:30 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:05:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4e2f481e-a99e-4a8a-a2c5-95af9e0796ed tempest-SnapshotsActionsTest-956287705 None] Create snapshot completed successfully Jun 24 16:05:30 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e 1073741824 Jun 24 16:05:30 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-7710ac58-e1a7-41fc-ab34-88d6d9030760-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-7710ac58-e1a7-41fc-ab34-88d6d9030760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Acquiring lock "cinder-quobyte-7710ac58-e1a7-41fc-ab34-88d6d9030760" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-7710ac58-e1a7-41fc-ab34-88d6d9030760" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Deleting offline snapshot 7710ac58-e1a7-41fc-ab34-88d6d9030760 of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] snapshot_file for this snap is: volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c785811-0e4b-4b8a-bb36-abcf5acf9c6e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:32 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 Jun 24 16:05:32 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:32 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e 1073741824" returned: 0 in 1.734s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:32 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e Jun 24 16:05:32 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:33 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760" returned: 0 in 1.701s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e765de-e7eb-4dcc-aec9-6206e0ba6aa1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:33 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e" returned: 0 in 1.266s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] <== create_volume: return (3081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.086s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c56df51-6ae6-4946-a987-72960ad9dd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bb4596-836e-4e20-973e-d75363cce81e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454a9241-5164-43a3-9a07-5215862fe84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:05:33 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:33 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Volume volume-b4bb4596-836e-4e20-973e-d75363cce81e (b4bb4596-836e-4e20-973e-d75363cce81e): created successfully Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454a9241-5164-43a3-9a07-5215862fe84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:05:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Flow 'volume_create_manager' (4ce13a36-5055-4eac-b43b-fcb7250021c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:05:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-75019e51-ffc8-40f8-a6ae-8920940100a3 tempest-AttachVolumeTestJSON-551800762 None] Created volume successfully. Jun 24 16:05:35 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 1.344s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:35 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 Jun 24 16:05:35 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:36 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760" returned: 0 in 0.946s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:36 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760 Jun 24 16:05:36 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:36 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.7710ac58-e1a7-41fc-ab34-88d6d9030760" returned: 0 in 0.751s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-7710ac58-e1a7-41fc-ab34-88d6d9030760" released by "_delete_snapshot" :: held 4.898s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" released by "delete_snapshot" :: held 4.939s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Created reservations ['6ec00e80-d0b9-4d69-b37a-ab7c6a605b46', '98bfad9f-4a9f-4ae1-986b-45c40505995a', '02daafc2-799a-415c-8441-98475d9d3817', '0de8a176-4b7d-4776-ac14-6c8917346e90'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Delete snapshot completed successfully. Jun 24 16:05:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c8eefa83-7a68-4489-8a57-04ae481ddb60 tempest-SnapshotsActionsTest-2140052041 None] Lock "cinder-7710ac58-e1a7-41fc-ab34-88d6d9030760-delete_snapshot" released by "delete_snapshot" :: held 5.110s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "cinder-ce701268-3316-4d54-b94e-b5b3d2f9b0e2-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-ce701268-3316-4d54-b94e-b5b3d2f9b0e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "cinder-quobyte-ce701268-3316-4d54-b94e-b5b3d2f9b0e2" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-quobyte-ce701268-3316-4d54-b94e-b5b3d2f9b0e2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Deleting offline snapshot ce701268-3316-4d54-b94e-b5b3d2f9b0e2 of volume 31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] snapshot_file for this snap is: volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4784e51-d435-4d0a-be3b-803af197fbab]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:38 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ac6fe-0d28-4ef3-8784-6f419575c31c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:38 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:38 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:38 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e Jun 24 16:05:38 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:39 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 1.198s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31853497-b00c-4002-b45b-1c81ddb2a5df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:05:39 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:05:39 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3861f6f-949d-471e-95dc-d1b9c72fb049]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:39 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df Jun 24 16:05:39 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:39 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e" returned: 0 in 1.414s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.451s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-b4bb4596-836e-4e20-973e-d75363cce81e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57fa8b0d-845f-4f6f-b233-0f2c4012a9b5', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:05:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-527abecb-342a-48a3-98ac-e234d705ec54 req-f3c6eb60-0537-49a8-9647-2c88ee3006d1 tempest-AttachVolumeTestJSON-551800762 None] attachment_update completed successfully. Jun 24 16:05:39 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.798s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:05:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:05:40 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df" returned: 0 in 1.144s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:40 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:40 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:41 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.921s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:41 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2 Jun 24 16:05:41 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:42 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df.ce701268-3316-4d54-b94e-b5b3d2f9b0e2" returned: 0 in 0.775s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-quobyte-ce701268-3316-4d54-b94e-b5b3d2f9b0e2" released by "_delete_snapshot" :: held 4.235s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" released by "delete_snapshot" :: held 4.276s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:42 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Created reservations ['e5e3f6f9-c064-4540-8add-80f94bf4dea2', '40160123-01db-4427-9a54-12ca1bd15043', '0b166570-93ee-4685-8d98-29430550a1da', '704f4681-397e-4efd-90ed-de4896fc48c2'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Delete snapshot completed successfully. Jun 24 16:05:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76329c6a-9a8e-4c78-b92e-95df2f81860c tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-ce701268-3316-4d54-b94e-b5b3d2f9b0e2-delete_snapshot" released by "delete_snapshot" :: held 4.471s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "cinder-31853497-b00c-4002-b45b-1c81ddb2a5df-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-31853497-b00c-4002-b45b-1c81ddb2a5df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:05:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" acquired by "delete_volume" :: waited 0.040s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:05:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c109a3c-6da9-4529-8ca2-90b587d3b3a5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:05:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:43 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df Jun 24 16:05:43 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:44 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df" returned: 0 in 1.111s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:44 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df Jun 24 16:05:44 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:45 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31853497-b00c-4002-b45b-1c81ddb2a5df" returned: 0 in 0.804s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-quobyte-31853497-b00c-4002-b45b-1c81ddb2a5df" released by "delete_volume" :: held 2.034s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:45 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Created reservations ['d20e9d15-0326-4400-b693-ad3d265f0a96', '88f86c92-2f21-4150-b073-7e62f7c9fa90', '65ad4cb1-96bb-454d-92a9-d5dc1688baca', '26593dad-fbd9-48af-93aa-195a06d75e55'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:05:46 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:05:46 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:05:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-d5d99058-e290-4a5f-8b3f-4e48c59a404c req-61bc401a-fefc-4201-8b0b-f851aa0fe5b5 tempest-AttachVolumeTestJSON-551800762 None] Terminate volume connection completed successfully. Jun 24 16:05:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-d5d99058-e290-4a5f-8b3f-4e48c59a404c req-61bc401a-fefc-4201-8b0b-f851aa0fe5b5 tempest-AttachVolumeTestJSON-551800762 None] Deleting attachment d65c15ac-9347-4503-9fee-2bb558e9259b. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:05:47 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jun 24 16:05:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.727s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:05:47 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:05:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Deleted volume successfully. Jun 24 16:05:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0187d515-0d51-4d7d-bdab-de73151a1006 tempest-SnapshotsActionsTest-956287705 None] Lock "cinder-31853497-b00c-4002-b45b-1c81ddb2a5df-delete_volume" released by "delete_volume" :: held 3.795s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:05:50 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-6a0fdb26-a9c8-4a3e-a2c5-3c4f8b70996f req-df7be4a8-168a-4031-b94b-0f298eac7515 tempest-AttachVolumeTestJSON-551800762 None] Terminate volume connection completed successfully. Jun 24 16:05:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-6a0fdb26-a9c8-4a3e-a2c5-3c4f8b70996f req-df7be4a8-168a-4031-b94b-0f298eac7515 tempest-AttachVolumeTestJSON-551800762 None] Deleting attachment 57fa8b0d-845f-4f6f-b233-0f2c4012a9b5. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:06:00 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:INSERT=11,cinder:DELETE=3,cinder:UPDATE=37,cinder:SELECT=39 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:06:01 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-a7be670e-34ba-4a9c-9927-baeac24ab61f req-c566710f-6b3c-4342-8258-1937fe348d35 tempest-TestShelveInstance-267595778 None] Terminate volume connection completed successfully. Jun 24 16:06:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-a7be670e-34ba-4a9c-9927-baeac24ab61f req-c566710f-6b3c-4342-8258-1937fe348d35 tempest-TestShelveInstance-267595778 None] Deleting attachment 2fefd509-f538-4de2-b3eb-bf4bacdfcb79. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:06:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "cinder-b4bb4596-836e-4e20-973e-d75363cce81e-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-b4bb4596-836e-4e20-973e-d75363cce81e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "cinder-quobyte-b4bb4596-836e-4e20-973e-d75363cce81e" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-quobyte-b4bb4596-836e-4e20-973e-d75363cce81e" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:03 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[51390384-ed3d-490b-a83a-99e266ec2885]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:04 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e Jun 24 16:06:04 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:04 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e" returned: 0 in 1.090s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:05 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e Jun 24 16:06:05 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:05 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b4bb4596-836e-4e20-973e-d75363cce81e" returned: 0 in 0.828s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-quobyte-b4bb4596-836e-4e20-973e-d75363cce81e" released by "delete_volume" :: held 1.992s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Created reservations ['4b1cf297-90b0-4df8-a357-51fd66fe933e', '6e78f301-eb38-41d4-a28c-17a73ae54937', '3a5a9d48-ec48-4d30-ba1c-dc9652c2d9e4', '0bd819ec-6198-4f48-9774-ccb367e2589a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:06 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:06:06 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "cinder-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "cinder-quobyte-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-quobyte-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a357e-2ef8-4b76-9e27-ca81efd7a3b1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:06 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 Jun 24 16:06:06 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:07 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.027s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:07 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:06:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Deleted volume successfully. Jun 24 16:06:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d68c16e6-3283-4ce9-badc-9198e5c2a58f tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-b4bb4596-836e-4e20-973e-d75363cce81e-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:07 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" returned: 0 in 1.278s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:07 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4 Jun 24 16:06:07 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:08 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" returned: 0 in 0.742s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-quobyte-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4" released by "delete_volume" :: held 2.093s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Created reservations ['fedec689-5d25-46a1-8206-c1591fff2d4d', 'b7390654-2f4d-484a-bf39-e3ee626c82a0', '02465ffd-68e0-4568-af09-ddd096049d53', 'e0c405a4-f2a0-408c-ae57-baa1617d6c0a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:08 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:06:08 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a171483-96fa-409a-b03b-2c028e771bfc]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:09 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:06:09 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:09 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.857s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:06:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Deleted volume successfully. Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b300a48d-8c29-490e-ae81-11631520dbd6 tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-1d18b0f1-2fdd-4d4c-ace0-8450176b56f4-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "cinder-bfc941ba-545e-4a74-923c-867ec3214712-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-bfc941ba-545e-4a74-923c-867ec3214712-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "cinder-quobyte-bfc941ba-545e-4a74-923c-867ec3214712" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-quobyte-bfc941ba-545e-4a74-923c-867ec3214712" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b67c29-9000-4398-8a1f-f7bb0d68333c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:10 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 Jun 24 16:06:10 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:10 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 1.146s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:10 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:06:10 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:11 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712" returned: 0 in 1.146s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:11 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712 Jun 24 16:06:11 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:11 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 1 in 1.089s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.284s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-2534907a-880e-41aa-91ae-94b7f3587dd1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '210e2171-ab96-4cb1-a98f-1c30607f11ce', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:06:11 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-12f48026-b22a-4e33-9ecb-eaeeffcec7c3 req-68432b53-bd6f-4596-aaa0-8d0587246d17 tempest-TestShelveInstance-267595778 None] attachment_update completed successfully. Jun 24 16:06:11 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfc941ba-545e-4a74-923c-867ec3214712" returned: 0 in 0.826s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-quobyte-bfc941ba-545e-4a74-923c-867ec3214712" released by "delete_volume" :: held 2.034s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:11 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Created reservations ['4455cd87-3d0a-4743-8de1-b1ef658d6f4c', '71746099-6cc5-45ae-b4bd-7c5e7c864138', '04661d60-c24d-46f3-a4de-0b18e785f27d', '6cbf3d0f-baa1-422b-930b-edbd1c6910b2'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:06:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:12 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:06:12 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:13 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.991s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:13 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:06:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Deleted volume successfully. Jun 24 16:06:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-adfd7958-127b-49e1-9ae6-bc0b19d9f06b tempest-AttachVolumeTestJSON-551800762 None] Lock "cinder-bfc941ba-545e-4a74-923c-867ec3214712-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Flow 'volume_create_manager' (1edfe27f-49eb-4fc7-8a5c-ca39f6d76c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbcea45-d223-4f08-a054-54db749d68af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbcea45-d223-4f08-a054-54db749d68af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1220480495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5b82e3-e909-4b8a-b40f-f67df82a698a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b51909ea71b4d659e3251b5f6869660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:15Z,use_quota=True,user_id='d04455ca2dba4ea7bec6eb3e982287ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9394f8da-5979-48df-8d50-261e47b5483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9394f8da-5979-48df-8d50-261e47b5483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa10c6c-f65f-4a1e-8246-0544bd6bbef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa10c6c-f65f-4a1e-8246-0544bd6bbef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5b82e3-e909-4b8a-b40f-f67df82a698a', 'volume_name': 'volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2c230e-99ae-40e6-9aa0-dc9c06741c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2c230e-99ae-40e6-9aa0-dc9c06741c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fb1aa4-485e-47ce-8865-582b5cd0e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:15 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Volume 2b5b82e3-e909-4b8a-b40f-f67df82a698a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a', 'volume_size': 1} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1220480495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5b82e3-e909-4b8a-b40f-f67df82a698a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b51909ea71b4d659e3251b5f6869660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:15Z,use_quota=True,user_id='d04455ca2dba4ea7bec6eb3e982287ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Creating volume 2b5b82e3-e909-4b8a-b40f-f67df82a698a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:06:15 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:06:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:15 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a 1073741824 Jun 24 16:06:15 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:16 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a 1073741824" returned: 0 in 1.080s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:16 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a Jun 24 16:06:16 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:17 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a" returned: 0 in 0.906s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fb1aa4-485e-47ce-8865-582b5cd0e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4453c80-f960-429a-a069-9603e7bfdf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:17 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Volume volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a (2b5b82e3-e909-4b8a-b40f-f67df82a698a): created successfully Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4453c80-f960-429a-a069-9603e7bfdf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Flow 'volume_create_manager' (1edfe27f-49eb-4fc7-8a5c-ca39f6d76c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-42da6856-f90c-4b6d-a029-3bb48e1e75d8 tempest-VolumesServicesTestJSON-647351959 None] Created volume successfully. Jun 24 16:06:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Acquiring lock "cinder-2b5b82e3-e909-4b8a-b40f-f67df82a698a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Lock "cinder-2b5b82e3-e909-4b8a-b40f-f67df82a698a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Acquiring lock "cinder-quobyte-2b5b82e3-e909-4b8a-b40f-f67df82a698a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Lock "cinder-quobyte-2b5b82e3-e909-4b8a-b40f-f67df82a698a" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:18 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6619fc-f7ec-4871-b831-1021f41eccaf]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:18 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a Jun 24 16:06:18 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:19 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a" returned: 0 in 0.813s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:19 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a Jun 24 16:06:19 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:20 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2b5b82e3-e909-4b8a-b40f-f67df82a698a" returned: 0 in 1.053s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Lock "cinder-quobyte-2b5b82e3-e909-4b8a-b40f-f67df82a698a" released by "delete_volume" :: held 1.927s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=78,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Created reservations ['64262c67-9ec5-420b-9cbc-a9656685b555', '62b835e0-94ea-4a98-88ca-40c19fba49e5', 'fba451d8-eae2-4698-9d55-b29b9c5ad12d', 'b24d6232-f1a1-43a9-95b8-4a92b0237d93'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:20 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:06:20 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Flow 'volume_create_manager' (2ceaab2e-9f6a-40c8-bb54-ff9a940d27bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafda413-1c9e-47c6-9c9f-2e55ecdeb71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafda413-1c9e-47c6-9c9f-2e55ecdeb71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1104325444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b698e5f7-e71e-42d2-b188-f72c7859ee05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e12738a7496e4e13bf51b60aa057365d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:21Z,use_quota=True,user_id='08232cb6900e410a88f7b0f458911f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba2c1d8-471f-4794-8f60-578447ab4815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba2c1d8-471f-4794-8f60-578447ab4815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2f0e31-b488-4a09-8395-90c3af17c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2f0e31-b488-4a09-8395-90c3af17c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b698e5f7-e71e-42d2-b188-f72c7859ee05', 'volume_name': 'volume-b698e5f7-e71e-42d2-b188-f72c7859ee05', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32de022a-2540-48ce-a6d9-df0aa404f155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32de022a-2540-48ce-a6d9-df0aa404f155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cc54e3-dbd6-44be-8825-06801bae2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:21 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Volume b698e5f7-e71e-42d2-b188-f72c7859ee05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b698e5f7-e71e-42d2-b188-f72c7859ee05', 'volume_size': 1} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1104325444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b698e5f7-e71e-42d2-b188-f72c7859ee05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e12738a7496e4e13bf51b60aa057365d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:21Z,use_quota=True,user_id='08232cb6900e410a88f7b0f458911f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Creating volume b698e5f7-e71e-42d2-b188-f72c7859ee05 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:06:21 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:21 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 1073741824 Jun 24 16:06:21 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:21 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.302s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:21 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:06:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Deleted volume successfully. Jun 24 16:06:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d143917a-5bb4-4ca5-98f6-f4930df80f37 tempest-VolumesServicesTestJSON-647351959 None] Lock "cinder-2b5b82e3-e909-4b8a-b40f-f67df82a698a-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:22 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 1073741824" returned: 0 in 1.269s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:22 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 Jun 24 16:06:22 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:23 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05" returned: 0 in 0.989s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cc54e3-dbd6-44be-8825-06801bae2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b698e5f7-e71e-42d2-b188-f72c7859ee05', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b114257-2502-497f-9f06-e41c48438d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Volume volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 (b698e5f7-e71e-42d2-b188-f72c7859ee05): created successfully Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b114257-2502-497f-9f06-e41c48438d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Flow 'volume_create_manager' (2ceaab2e-9f6a-40c8-bb54-ff9a940d27bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-3c4dacf7-a4fd-41e9-b024-c5620ed66657 req-7e8bda91-ac4a-4534-b758-c40e3a2ec51c tempest-VolumesGetTestJSON-2090520884 None] Created volume successfully. Jun 24 16:06:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Acquiring lock "cinder-b698e5f7-e71e-42d2-b188-f72c7859ee05-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Lock "cinder-b698e5f7-e71e-42d2-b188-f72c7859ee05-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Acquiring lock "cinder-quobyte-b698e5f7-e71e-42d2-b188-f72c7859ee05" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Lock "cinder-quobyte-b698e5f7-e71e-42d2-b188-f72c7859ee05" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4848966-34b3-47a5-8dfb-dfc42bc1d921]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:25 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 Jun 24 16:06:25 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:26 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05" returned: 0 in 0.981s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:26 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05 Jun 24 16:06:26 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:27 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b698e5f7-e71e-42d2-b188-f72c7859ee05" returned: 0 in 0.873s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Lock "cinder-quobyte-b698e5f7-e71e-42d2-b188-f72c7859ee05" released by "delete_volume" :: held 1.921s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG cinder.quota [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Created reservations ['3eeef976-fb2e-4e79-9b91-04983eb942ff', 'cf8c5bff-9918-43c5-9202-33defad0cc8e', 'f4e7e011-baba-418d-9d86-7e062a2e764d', 'f2ab7e26-ac74-4b17-98be-5293b984b499'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:27 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:06:27 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:28 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.110s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:28 devstack cinder-volume[93867]: DEBUG cinder.manager [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:06:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Deleted volume successfully. Jun 24 16:06:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-b4beda15-e1e6-4290-8917-19cf6db10d4d req-4e0d4e26-f742-451b-a353-b2de795eea94 tempest-VolumesGetTestJSON-2090520884 None] Lock "cinder-b698e5f7-e71e-42d2-b188-f72c7859ee05-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Flow 'volume_create_manager' (b33ca57c-3b76-4760-a476-698a9c94b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1d1cab-be06-4f6d-bef5-7e503f521e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1d1cab-be06-4f6d-bef5-7e503f521e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1726058687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d369a79d-a43d-4780-9e2a-c9ee6ffc127d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040fb94fd64a4c54a9619b467b3c754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:36Z,use_quota=True,user_id='ca8362ae5ae447868470812eace94804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395ed82d-50f1-4a3a-93c6-55a42ff053f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395ed82d-50f1-4a3a-93c6-55a42ff053f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0631af5-ba4b-4dd6-b8e8-bf32e6d3e32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0631af5-ba4b-4dd6-b8e8-bf32e6d3e32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd369a79d-a43d-4780-9e2a-c9ee6ffc127d', 'volume_name': 'volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792e2031-4d77-4b7a-ae01-cd9c156debef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792e2031-4d77-4b7a-ae01-cd9c156debef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2aa314-ba5e-42cd-8940-aa66a87f9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:36 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Volume d369a79d-a43d-4780-9e2a-c9ee6ffc127d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d', 'volume_size': 1} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1726058687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d369a79d-a43d-4780-9e2a-c9ee6ffc127d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040fb94fd64a4c54a9619b467b3c754a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:36Z,use_quota=True,user_id='ca8362ae5ae447868470812eace94804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Creating volume d369a79d-a43d-4780-9e2a-c9ee6ffc127d {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:06:36 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:06:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:36 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d 1073741824 Jun 24 16:06:36 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5b3ac4a4-c515-4a13-9ad8-faa0db0b09fe tempest-GroupsV314Test-877060637 None] Group tempest-GroupsV314Test-Group-2145313007: creating Jun 24 16:06:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5b3ac4a4-c515-4a13-9ad8-faa0db0b09fe tempest-GroupsV314Test-877060637 None] Group tempest-GroupsV314Test-Group-2145313007: created successfully Jun 24 16:06:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5b3ac4a4-c515-4a13-9ad8-faa0db0b09fe tempest-GroupsV314Test-877060637 None] Create group completed successfully. Jun 24 16:06:37 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d 1073741824" returned: 0 in 1.196s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:37 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d Jun 24 16:06:37 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:39 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" returned: 0 in 1.148s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2aa314-ba5e-42cd-8940-aa66a87f9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216e7c7d-8d23-47cd-9388-845520127a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Volume volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d (d369a79d-a43d-4780-9e2a-c9ee6ffc127d): created successfully Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216e7c7d-8d23-47cd-9388-845520127a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Flow 'volume_create_manager' (b33ca57c-3b76-4760-a476-698a9c94b55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-35e86cae-1d08-4e3e-892a-24fe60efcd5c tempest-TestMinimumBasicScenario-124510732 None] Created volume successfully. Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:39 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:06:39 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Flow 'volume_create_manager' (6703c274-b93e-4574-a77e-62de387742db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342d38bf-c0c3-40c4-a2b4-70d98a30caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342d38bf-c0c3-40c4-a2b4-70d98a30caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874594094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c819cc38-5b3a-4e3c-8771-7e6c0650543d,host='devstack@QuobyteHD#QuobyteHD',id=fc691c66-de10-4951-90a4-c12b7a40763a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2525fb72fd25425691407cb04d1f4846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:39Z,use_quota=True,user_id='35554973d1fe46599b064615d6eeaac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9871dc4f-5525-4327-9f9e-488aa26e4705),volume_type_id=9871dc4f-5525-4327-9f9e-488aa26e4705)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869086a1-05a7-435c-9a52-9e20354c8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869086a1-05a7-435c-9a52-9e20354c8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7fbcfc-2d7a-40f5-9806-d42c8bf62410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7fbcfc-2d7a-40f5-9806-d42c8bf62410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc691c66-de10-4951-90a4-c12b7a40763a', 'volume_name': 'volume-fc691c66-de10-4951-90a4-c12b7a40763a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1549b01-4dd4-44f0-b944-f108215df882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1549b01-4dd4-44f0-b944-f108215df882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17aecef-38ea-46bb-8c4e-73fb0eaa27e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Volume fc691c66-de10-4951-90a4-c12b7a40763a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc691c66-de10-4951-90a4-c12b7a40763a', 'volume_size': 1} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c819cc38-5b3a-4e3c-8771-7e6c0650543d,created_at=2026-06-24T14:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874594094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c819cc38-5b3a-4e3c-8771-7e6c0650543d,host='devstack@QuobyteHD#QuobyteHD',id=fc691c66-de10-4951-90a4-c12b7a40763a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2525fb72fd25425691407cb04d1f4846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:39Z,use_quota=True,user_id='35554973d1fe46599b064615d6eeaac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9871dc4f-5525-4327-9f9e-488aa26e4705),volume_type_id=9871dc4f-5525-4327-9f9e-488aa26e4705)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Creating volume fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:06:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:06:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:39 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a 1073741824 Jun 24 16:06:39 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:41 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a 1073741824" returned: 0 in 1.840s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:41 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 2.196s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:06:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:06:41 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:06:41 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:43 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 1.696s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] <== create_volume: return (3635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.650s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17aecef-38ea-46bb-8c4e-73fb0eaa27e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc691c66-de10-4951-90a4-c12b7a40763a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2e2940-a950-4065-80ba-af56665bfd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:43 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Volume volume-fc691c66-de10-4951-90a4-c12b7a40763a (fc691c66-de10-4951-90a4-c12b7a40763a): created successfully Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2e2940-a950-4065-80ba-af56665bfd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Flow 'volume_create_manager' (6703c274-b93e-4574-a77e-62de387742db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bd4a2b5a-03fd-48f7-8c2a-d7c13199af43 tempest-GroupsV314Test-877060637 None] Created volume successfully. Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1483f312-5b7c-4cbb-9f76-369437220814]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:44 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d Jun 24 16:06:44 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:44 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" returned: 0 in 0.970s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.065s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:44 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Cloning volume fc691c66-de10-4951-90a4-c12b7a40763a to volume 5151db36-29ff-4045-8bac-b2c476cb74e2 Jun 24 16:06:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Creating offline snapshot 8a900773-79f7-427b-b9d5-be4c2ac2d5c6 of volume fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:06:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65ba6a95-49f1-46f2-a268-7935d4b5590f', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:06:45 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dc3b61-c6ce-4275-a683-14cbf193568b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:45 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-3b2e38ad-cf72-42a6-8d42-33b27acc48e1 req-36dfcd3d-6b29-4619-a280-a311a69c063c tempest-TestMinimumBasicScenario-124510732 None] attachment_update completed successfully. Jun 24 16:06:45 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:06:45 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:46 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 1.019s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:46 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 1G Jun 24 16:06:46 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:47 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 1G" returned: 0 in 0.899s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc691c66-de10-4951-90a4-c12b7a40763a -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:47 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc691c66-de10-4951-90a4-c12b7a40763a -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 Jun 24 16:06:47 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Flow 'volume_create_manager' (2be8632f-a98d-4bf7-b1b9-62db1708a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a012f8c6-e535-4c0c-a3dc-d63ecf26a62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a012f8c6-e535-4c0c-a3dc-d63ecf26a62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-91726293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8171f247-6456-4bff-a2f2-04f93504d6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6717e28b4947aeb7f41f08814cac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:48Z,use_quota=True,user_id='e7d794470f03492fbe8ca532b235c9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583d701b-840a-4278-9886-8da0ec5c5883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583d701b-840a-4278-9886-8da0ec5c5883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9eb2dd5-33ad-4318-a222-9209a379b99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9eb2dd5-33ad-4318-a222-9209a379b99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8171f247-6456-4bff-a2f2-04f93504d6db', 'volume_name': 'volume-8171f247-6456-4bff-a2f2-04f93504d6db', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3209790-c6e9-4d0c-8a12-f08a6a0b2b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3209790-c6e9-4d0c-8a12-f08a6a0b2b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ff35fe-1863-4c2d-a7d8-a7dd95a69388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:06:47 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Volume 8171f247-6456-4bff-a2f2-04f93504d6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8171f247-6456-4bff-a2f2-04f93504d6db', 'volume_size': 1} Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:47 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc691c66-de10-4951-90a4-c12b7a40763a -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6" returned: 0 in 0.725s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:47 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:06:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:47 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 Jun 24 16:06:47 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:48 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6" returned: 0 in 0.643s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:48 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info Jun 24 16:06:48 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:49 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:49 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:49 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info Jun 24 16:06:49 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:49 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.info" returned: 0 in 0.709s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Acquiring lock "cinder-quobyte-5151db36-29ff-4045-8bac-b2c476cb74e2" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-5151db36-29ff-4045-8bac-b2c476cb74e2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] snapshot: 8a900773-79f7-427b-b9d5-be4c2ac2d5c6, volume: 5151db36-29ff-4045-8bac-b2c476cb74e2, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc99b602-74ea-4cbe-86c7-ef7afb05d136]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:50 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 Jun 24 16:06:50 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:50 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6" returned: 0 in 0.837s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc691c66-de10-4951-90a4-c12b7a40763a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:06:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:06:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:06:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2647ba2f-4889-4dc4-b33a-bae174ada174]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:50 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:06:50 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:51 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 0.789s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:51 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:06:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:51 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 Jun 24 16:06:51 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:58 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2" returned: 0 in 6.490s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:58 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d25b4-c8cc-496f-81af-2dbd0ffca04e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:58 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:06:58 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:58 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=31,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:06:58 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=58,cinder:INSERT=14,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:06:59 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 0.971s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:06:59 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Converted 1024.00 MB image at 157.75 MB/s Jun 24 16:06:59 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:59 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 Jun 24 16:06:59 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:06:59 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2" returned: 0 in 0.697s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-5151db36-29ff-4045-8bac-b2c476cb74e2" released by "_copy_volume_from_snapshot" :: held 9.896s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Acquiring lock "cinder-quobyte-8a900773-79f7-427b-b9d5-be4c2ac2d5c6" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-8a900773-79f7-427b-b9d5-be4c2ac2d5c6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Deleting offline snapshot 8a900773-79f7-427b-b9d5-be4c2ac2d5c6 of volume fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] snapshot_file for this snap is: volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd21ae5f-9099-41b9-b640-e1f1d9eaa05c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:06:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:06:59 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 Jun 24 16:06:59 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:00 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6" returned: 0 in 0.825s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc691c66-de10-4951-90a4-c12b7a40763a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:07:00 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[09283239-75b3-4a07-8d6a-9dd5745fccc1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:00 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:07:00 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:01 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 0.777s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:01 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 Jun 24 16:07:01 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:02 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6" returned: 0 in 0.756s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:02 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6 Jun 24 16:07:02 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:02 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a.8a900773-79f7-427b-b9d5-be4c2ac2d5c6" returned: 0 in 0.758s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-8a900773-79f7-427b-b9d5-be4c2ac2d5c6" released by "_delete_snapshot" :: held 3.242s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.045s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.357s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-91726293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8171f247-6456-4bff-a2f2-04f93504d6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6717e28b4947aeb7f41f08814cac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:06:48Z,use_quota=True,user_id='e7d794470f03492fbe8ca532b235c9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Creating volume 8171f247-6456-4bff-a2f2-04f93504d6db {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:03 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:03 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db 1073741824 Jun 24 16:07:03 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:03 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-00d4f888-cbf1-401d-be5e-8abce2825b29 tempest-GroupsV314Test-877060637 None] Create group from source-group-c819cc38-5b3a-4e3c-8771-7e6c0650543d completed successfully. Jun 24 16:07:04 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db 1073741824" returned: 0 in 0.940s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:04 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db Jun 24 16:07:04 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Acquiring lock "cinder-quobyte-5151db36-29ff-4045-8bac-b2c476cb74e2" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-5151db36-29ff-4045-8bac-b2c476cb74e2" acquired by "delete_volume" :: waited 0.039s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79c375-369b-4449-a76a-7bc8a269f567]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:05 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db" returned: 0 in 0.943s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ff35fe-1863-4c2d-a7d8-a7dd95a69388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8171f247-6456-4bff-a2f2-04f93504d6db', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:05 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 Jun 24 16:07:05 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96418aa1-3232-455c-ae3e-9dc5746aa074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Volume volume-8171f247-6456-4bff-a2f2-04f93504d6db (8171f247-6456-4bff-a2f2-04f93504d6db): created successfully Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96418aa1-3232-455c-ae3e-9dc5746aa074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Flow 'volume_create_manager' (2be8632f-a98d-4bf7-b1b9-62db1708a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9edd08c2-a3cd-440c-9a2d-407c74323572 tempest-VolumesTransfersTest-893881111 None] Created volume successfully. Jun 24 16:07:05 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2" returned: 0 in 0.925s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:05 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2 Jun 24 16:07:05 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e668cecb-4ddc-419c-8c8a-df9c0b641ce0 tempest-VolumesTransfersTest-208164279 None] Transfer volume completed successfully. Jun 24 16:07:06 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5151db36-29ff-4045-8bac-b2c476cb74e2" returned: 0 in 0.741s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-5151db36-29ff-4045-8bac-b2c476cb74e2" released by "delete_volume" :: held 1.760s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Created reservations ['96299a41-d073-464c-bf9a-ebf4ac409b90'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:06 devstack cinder-volume[93867]: WARNING cinder.quota [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1715424360 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1715424360, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:07:06 devstack cinder-volume[93867]: WARNING cinder.quota [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1715424360 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1715424360, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Created reservations ['f1851c34-0b5a-45fd-90aa-6cf3fc1b4e04', '93773a09-a3d6-4b92-b30d-e218a85d237e', 'f7067199-1d51-4067-bdf7-4ef6ebfcee7e', '6ade68ba-01fc-4e08-8746-39054ec59d67'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:06 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:06 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Acquiring lock "cinder-8171f247-6456-4bff-a2f2-04f93504d6db-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-8171f247-6456-4bff-a2f2-04f93504d6db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Acquiring lock "cinder-quobyte-8171f247-6456-4bff-a2f2-04f93504d6db" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-quobyte-8171f247-6456-4bff-a2f2-04f93504d6db" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4a8375-b3c6-48f7-81aa-70b7af0239e2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:07 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db Jun 24 16:07:07 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Acquiring lock "cinder-quobyte-fc691c66-de10-4951-90a4-c12b7a40763a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-fc691c66-de10-4951-90a4-c12b7a40763a" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97736fe-abe3-45a9-a603-d43a8ca83647]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:07 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.883s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6ba3c679-1353-45c1-8761-c42672411335 tempest-GroupsV314Test-877060637 None] Delete group completed successfully. Jun 24 16:07:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-f50abb73-8d63-4c20-bae9-54a4ab8f7b48 tempest-TestShelveInstance-267595778 None] Terminate volume connection completed successfully. Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-f50abb73-8d63-4c20-bae9-54a4ab8f7b48 tempest-TestShelveInstance-267595778 None] Deleting attachment 210e2171-ab96-4cb1-a98f-1c30607f11ce. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:07:07 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:07:07 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:07 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db" returned: 0 in 0.908s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:07 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db Jun 24 16:07:07 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Acquiring lock "cinder-2534907a-880e-41aa-91ae-94b7f3587dd1-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Lock "cinder-2534907a-880e-41aa-91ae-94b7f3587dd1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Acquiring lock "cinder-quobyte-2534907a-880e-41aa-91ae-94b7f3587dd1" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Lock "cinder-quobyte-2534907a-880e-41aa-91ae-94b7f3587dd1" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[12607265-5b3f-48bd-8f2e-a293c0ed2b85]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:08 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 0.872s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:08 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a Jun 24 16:07:08 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:08 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:08 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:07:08 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8171f247-6456-4bff-a2f2-04f93504d6db" returned: 0 in 0.695s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-quobyte-8171f247-6456-4bff-a2f2-04f93504d6db" released by "delete_volume" :: held 1.662s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Created reservations ['5de398e4-6495-4a61-bedd-5af67182abaa', '43ccfb33-e681-4980-b2a7-b6c8ac4e8169', 'ea93f971-5a1b-42eb-be63-d4a13b1d9346', 'dd558917-a73f-4c72-b75e-0397ebf82479'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:08 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:08 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:09 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc691c66-de10-4951-90a4-c12b7a40763a" returned: 0 in 1.164s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Lock "cinder-quobyte-fc691c66-de10-4951-90a4-c12b7a40763a" released by "delete_volume" :: held 2.152s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:09 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 1.312s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:09 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Created reservations ['5c65b26f-2d6f-498d-9603-c47773e64083'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:09 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Created reservations ['8529090c-b924-4643-a84b-2f1d0d7b5d88', 'd7ca33f8-820b-4bce-8575-4ed555debbd7', '9fbc30f9-0d14-48f4-afab-d736f2da2597', 'cc07f000-0cdb-4f1b-9414-6104eacc1c4c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:09 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:07:09 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:10 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.156s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:10 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Deleted volume successfully. Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-665a60cb-6793-490d-9c48-f3af04c20fc4 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-8171f247-6456-4bff-a2f2-04f93504d6db-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:10 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:10 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Flow 'volume_create_manager' (4664e531-e27c-4c16-98e3-ec79b6d1f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b2ac2a-2fdd-4847-a45e-cdd2c7255793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b2ac2a-2fdd-4847-a45e-cdd2c7255793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1432683675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4448b00c-d3e5-4a4c-9b46-b6b540b24f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6717e28b4947aeb7f41f08814cac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:10Z,use_quota=True,user_id='e7d794470f03492fbe8ca532b235c9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152490ab-a3da-4d6c-b555-8cd752969846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152490ab-a3da-4d6c-b555-8cd752969846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86257d29-f532-4438-a545-77b4a8fdee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86257d29-f532-4438-a545-77b4a8fdee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4448b00c-d3e5-4a4c-9b46-b6b540b24f3c', 'volume_name': 'volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939fffb2-12a7-4115-8632-23f1ca554854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939fffb2-12a7-4115-8632-23f1ca554854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db049e5f-8cb5-4026-b65d-ef0161ff4415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:10 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Volume 4448b00c-d3e5-4a4c-9b46-b6b540b24f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c', 'volume_size': 1} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1432683675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4448b00c-d3e5-4a4c-9b46-b6b540b24f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6717e28b4947aeb7f41f08814cac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:10Z,use_quota=True,user_id='e7d794470f03492fbe8ca532b235c9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Creating volume 4448b00c-d3e5-4a4c-9b46-b6b540b24f3c {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:10 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:10 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c 1073741824 Jun 24 16:07:10 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:10 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 1 in 1.028s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:07:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:10 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1 Jun 24 16:07:10 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:11 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.959s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:11 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:11 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d5b70289-578f-4f0d-b515-33dbd40c9ff0 tempest-GroupsV314Test-877060637 None] Delete group completed successfully. Jun 24 16:07:11 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c 1073741824" returned: 0 in 1.103s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:11 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c Jun 24 16:07:11 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:11 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-2534907a-880e-41aa-91ae-94b7f3587dd1" returned: 0 in 0.999s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Lock "cinder-quobyte-2534907a-880e-41aa-91ae-94b7f3587dd1" released by "delete_volume" :: held 3.434s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.quota [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Created reservations ['4dc1cc56-3809-4824-b5bb-014e6b7e649a', 'fc9bddce-a468-490b-a674-4c43187ac656', '24ccacba-44e2-426f-b869-897403381a62', '6ed6910f-4ab9-413c-963a-e8f69fb23ff1'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:12 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:12 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:12 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c" returned: 0 in 1.438s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.604s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db049e5f-8cb5-4026-b65d-ef0161ff4415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205667c4-bff5-4b3a-b499-6353cb21829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Volume volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c (4448b00c-d3e5-4a4c-9b46-b6b540b24f3c): created successfully Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205667c4-bff5-4b3a-b499-6353cb21829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Flow 'volume_create_manager' (4664e531-e27c-4c16-98e3-ec79b6d1f60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5f9ca659-6bec-416a-96c7-e28a1a25e67e tempest-VolumesTransfersTest-893881111 None] Created volume successfully. Jun 24 16:07:13 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.908s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:13 devstack cinder-volume[93867]: DEBUG cinder.manager [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Deleted volume successfully. Jun 24 16:07:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [req-1ac664cb-da1d-4074-9916-89f0a49ab3c6 req-aae56f9f-63fe-44fa-8030-28b7b1b6ddf8 tempest-TestShelveInstance-267595778 None] Lock "cinder-2534907a-880e-41aa-91ae-94b7f3587dd1-delete_volume" released by "delete_volume" :: held 4.835s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Acquiring lock "cinder-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Acquiring lock "cinder-quobyte-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-quobyte-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c" acquired by "delete_volume" :: waited 0.032s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e409162a-9cb3-45d9-8aca-60d68d3427c1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:14 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c Jun 24 16:07:14 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:15 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c" returned: 0 in 1.041s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:15 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c Jun 24 16:07:15 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:16 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c" returned: 0 in 1.143s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-quobyte-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c" released by "delete_volume" :: held 2.268s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Created reservations ['b7813aaf-aef2-4511-9de3-dcda2c5e818a', '34a73c8e-0cc8-4074-b96a-c4637a414bd5', 'ca94755e-122d-4d98-afde-ec90a524128f', '8afa2648-3a65-44da-9f20-c1dcb7e270c6'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:16 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:16 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:17 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.994s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:17 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Deleted volume successfully. Jun 24 16:07:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-92956da5-612f-4419-b5e4-ca12a5de62c8 tempest-VolumesTransfersTest-210495185 None] Lock "cinder-4448b00c-d3e5-4a4c-9b46-b6b540b24f3c-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9d40cbcc-15f7-4734-aa21-9e63b390b1bd tempest-GroupsV320Test-1954934447 None] Group tempest-GroupsV320Test-Group-2002667073: creating Jun 24 16:07:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9d40cbcc-15f7-4734-aa21-9e63b390b1bd tempest-GroupsV320Test-1954934447 None] Group tempest-GroupsV320Test-Group-2002667073: created successfully Jun 24 16:07:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9d40cbcc-15f7-4734-aa21-9e63b390b1bd tempest-GroupsV320Test-1954934447 None] Create group completed successfully. Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Created reservations ['9fece1a5-b6d4-4be7-b182-c5d74352b18b'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:22 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:22 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:23 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.104s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:23 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b9d36f93-8f5d-4521-9e51-a44582dea150 tempest-GroupsV320Test-1954934447 None] Delete group completed successfully. Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (b3ae61cb-a958-4847-9338-a6c84bfbf99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027ea293-a5b1-4e04-97f2-9724497b2bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027ea293-a5b1-4e04-97f2-9724497b2bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1543157811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bbcbc6-db93-4745-917e-7f14b4945700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:30Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0432c337-6094-491f-ad7a-cac4d246ddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0432c337-6094-491f-ad7a-cac4d246ddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062eac2f-29f1-4d2a-b7f0-0f512b938733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062eac2f-29f1-4d2a-b7f0-0f512b938733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31bbcbc6-db93-4745-917e-7f14b4945700', 'volume_name': 'volume-31bbcbc6-db93-4745-917e-7f14b4945700', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e368709-31aa-4704-b782-069d738cb8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e368709-31aa-4704-b782-069d738cb8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20a878e-f2c7-423e-b1ee-b025e072761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:30 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume 31bbcbc6-db93-4745-917e-7f14b4945700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31bbcbc6-db93-4745-917e-7f14b4945700', 'volume_size': 1} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1543157811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bbcbc6-db93-4745-917e-7f14b4945700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:30Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Creating volume 31bbcbc6-db93-4745-917e-7f14b4945700 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:30 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:30 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 1073741824 Jun 24 16:07:30 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:31 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 1073741824" returned: 0 in 0.942s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Flow 'volume_create_manager' (1520b95f-a4da-4d41-8a54-0d16223ca46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfbc82b-f79e-4b4f-8d84-967f2d319384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfbc82b-f79e-4b4f-8d84-967f2d319384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2002004647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb0a57e-c16c-4e00-9b76-1771fafefa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d440f3e7dbdd46f09ac2127864120f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:32Z,use_quota=True,user_id='9e28c9315045484c8fd85b880e3826eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4e63f4-c640-425e-bdb8-c0cd331c60a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4e63f4-c640-425e-bdb8-c0cd331c60a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c362845-1c5c-4ccf-bda6-cb146b038494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c362845-1c5c-4ccf-bda6-cb146b038494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb0a57e-c16c-4e00-9b76-1771fafefa5a', 'volume_name': 'volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f769d7-a1f0-454d-92d3-33c9f59639fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f769d7-a1f0-454d-92d3-33c9f59639fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205e7168-3e91-49da-ba55-65b696802c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Volume 4cb0a57e-c16c-4e00-9b76-1771fafefa5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a', 'volume_size': 1} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:31 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 Jun 24 16:07:31 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:32 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700" returned: 0 in 0.717s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2002004647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb0a57e-c16c-4e00-9b76-1771fafefa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d440f3e7dbdd46f09ac2127864120f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:32Z,use_quota=True,user_id='9e28c9315045484c8fd85b880e3826eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Creating volume 4cb0a57e-c16c-4e00-9b76-1771fafefa5a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:32 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20a878e-f2c7-423e-b1ee-b025e072761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31bbcbc6-db93-4745-917e-7f14b4945700', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daff6b65-173d-4577-b30a-ea0137bf4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:32 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a 1073741824 Jun 24 16:07:32 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:32 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume volume-31bbcbc6-db93-4745-917e-7f14b4945700 (31bbcbc6-db93-4745-917e-7f14b4945700): created successfully Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daff6b65-173d-4577-b30a-ea0137bf4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (b3ae61cb-a958-4847-9338-a6c84bfbf99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-59df7134-8a3d-471b-9150-3b864845e5c7 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created volume successfully. Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (27efdb3f-2f32-4d50-ba3d-75e1748b28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1639532d-3f28-418c-8688-08e759f4c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1639532d-3f28-418c-8688-08e759f4c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219412919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7335bb1c-2528-4b6d-8c1e-e0fea268ba85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:33Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f347d4-f6c0-4111-9168-8ba581446f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f347d4-f6c0-4111-9168-8ba581446f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14884df-b0ca-41ab-bfc2-86e515ebf787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14884df-b0ca-41ab-bfc2-86e515ebf787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7335bb1c-2528-4b6d-8c1e-e0fea268ba85', 'volume_name': 'volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f3490e-9927-4ccc-869d-c4e91877247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f3490e-9927-4ccc-869d-c4e91877247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e556cc9-325a-4e03-8a70-c1e7cd178d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume 7335bb1c-2528-4b6d-8c1e-e0fea268ba85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85', 'volume_size': 1} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:33 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a 1073741824" returned: 0 in 1.210s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:33 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a Jun 24 16:07:33 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (9a07a996-71c8-4190-8ab3-1a25281d2a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5de6d46-8cdb-4219-85a9-0a1b1ea109b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5de6d46-8cdb-4219-85a9-0a1b1ea109b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593305239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce29ab-597c-47d2-b2a3-6a2515aec910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:34Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f09ecc1-3f20-4e86-92cc-1cf923cf07fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f09ecc1-3f20-4e86-92cc-1cf923cf07fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b9c68e-3a93-40f9-ae82-7d7baecfe351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b9c68e-3a93-40f9-ae82-7d7baecfe351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efce29ab-597c-47d2-b2a3-6a2515aec910', 'volume_name': 'volume-efce29ab-597c-47d2-b2a3-6a2515aec910', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f585c19-34dd-41d7-be15-df19cbb61b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f585c19-34dd-41d7-be15-df19cbb61b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759fe5c4-2bca-4140-bb93-fd5d2a30592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume efce29ab-597c-47d2-b2a3-6a2515aec910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efce29ab-597c-47d2-b2a3-6a2515aec910', 'volume_size': 1} Jun 24 16:07:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (789a4b81-e4c7-440e-8ff6-64ed43383b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f2324a-05d2-4f01-a232-e3a92ef1e3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f2324a-05d2-4f01-a232-e3a92ef1e3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1180198664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a9948c-52bd-45b6-9031-3ea1e39ee064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:34Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0035653b-2547-4337-bd85-85727dd303b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0035653b-2547-4337-bd85-85727dd303b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da297ea4-373b-4691-99f8-f1b5fe03bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da297ea4-373b-4691-99f8-f1b5fe03bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a9948c-52bd-45b6-9031-3ea1e39ee064', 'volume_name': 'volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e4b115-7833-484c-957a-99a071c2b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e4b115-7833-484c-957a-99a071c2b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4272efcb-1411-4ac3-bedb-c2c2567563df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:34 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume a9a9948c-52bd-45b6-9031-3ea1e39ee064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064', 'volume_size': 1} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:34 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a" returned: 0 in 1.081s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219412919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7335bb1c-2528-4b6d-8c1e-e0fea268ba85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:33Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Creating volume 7335bb1c-2528-4b6d-8c1e-e0fea268ba85 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:34 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205e7168-3e91-49da-ba55-65b696802c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6979dea-3714-49aa-9d91-e5a8c3d3ee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:34 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 1073741824 Jun 24 16:07:34 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:34 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Volume volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a (4cb0a57e-c16c-4e00-9b76-1771fafefa5a): created successfully Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6979dea-3714-49aa-9d91-e5a8c3d3ee08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Flow 'volume_create_manager' (1520b95f-a4da-4d41-8a54-0d16223ca46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:34 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (a6be8982-b07d-4d3b-b3a3-280793985e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c817694d-68c7-4127-babf-c5f54de5fb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e34e00d2-717f-418e-8489-d3109001f876 tempest-VolumeQuotasNegativeTestJSON-364254337 None] Created volume successfully. Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c817694d-68c7-4127-babf-c5f54de5fb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593741731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54fd7ea-1054-469a-85bf-e611789387ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:35Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83980f13-a9a5-44cb-ade4-a768cb0d7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83980f13-a9a5-44cb-ade4-a768cb0d7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d20a8f-de4c-4f11-8906-8e11bab0fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d20a8f-de4c-4f11-8906-8e11bab0fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54fd7ea-1054-469a-85bf-e611789387ba', 'volume_name': 'volume-b54fd7ea-1054-469a-85bf-e611789387ba', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a8e9c4-a356-47ed-aeef-ab20260eb412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a8e9c4-a356-47ed-aeef-ab20260eb412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a42610f-4d8b-4db7-b9c5-08c162cbb92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume b54fd7ea-1054-469a-85bf-e611789387ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54fd7ea-1054-469a-85bf-e611789387ba', 'volume_size': 1} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (bcbe12ab-77c2-438e-b1de-9f1efa7f7253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58e4999-211f-43c2-8c36-aac6a1c91e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58e4999-211f-43c2-8c36-aac6a1c91e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243189408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:35Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84d83d5-497a-4d76-8f9e-520cb62b6680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84d83d5-497a-4d76-8f9e-520cb62b6680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c57f6e1-cd8e-473a-94be-aa78ec139556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c57f6e1-cd8e-473a-94be-aa78ec139556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f', 'volume_name': 'volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafb72e9-90a8-4853-8444-d692c9413ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafb72e9-90a8-4853-8444-d692c9413ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fbbd7a-9549-4ce6-92bc-2c45e4715eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:35 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume 881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f', 'volume_size': 1} Jun 24 16:07:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:36 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 1073741824" returned: 0 in 1.180s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:36 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 Jun 24 16:07:36 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:36 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85" returned: 0 in 0.861s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.028s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593305239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce29ab-597c-47d2-b2a3-6a2515aec910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:34Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Creating volume efce29ab-597c-47d2-b2a3-6a2515aec910 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:36 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e556cc9-325a-4e03-8a70-c1e7cd178d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:37 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 1073741824 Jun 24 16:07:37 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1a2d7e-e7e8-48ed-a764-fb1445f37733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 (7335bb1c-2528-4b6d-8c1e-e0fea268ba85): created successfully Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1a2d7e-e7e8-48ed-a764-fb1445f37733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (27efdb3f-2f32-4d50-ba3d-75e1748b28fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f3d6f957-43f0-431a-a2ab-d565d3d4eb6b tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created volume successfully. Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Acquiring lock "cinder-4cb0a57e-c16c-4e00-9b76-1771fafefa5a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "cinder-4cb0a57e-c16c-4e00-9b76-1771fafefa5a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Acquiring lock "cinder-quobyte-4cb0a57e-c16c-4e00-9b76-1771fafefa5a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "cinder-quobyte-4cb0a57e-c16c-4e00-9b76-1771fafefa5a" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e1875f-18a7-4b14-8f2e-2ab55d5a9401]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:37 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a Jun 24 16:07:37 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:38 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 1073741824" returned: 0 in 1.302s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:38 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 Jun 24 16:07:38 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:38 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a" returned: 0 in 1.209s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:38 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a Jun 24 16:07:38 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:39 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:39 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:39 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Flow 'volume_create_manager' (f7fb10c2-b758-41c5-be68-81fd8d85a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ea30f6-b767-4406-b8de-ce50a9d04a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910" returned: 0 in 1.281s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] <== create_volume: return (2641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.647s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.976s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1180198664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a9948c-52bd-45b6-9031-3ea1e39ee064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:34Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Creating volume a9a9948c-52bd-45b6-9031-3ea1e39ee064 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ea30f6-b767-4406-b8de-ce50a9d04a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1207290753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4577f1d1-ffb3-4882-bf4a-674ef67c5444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21669c2be04044019304ef00035dc23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:39Z,use_quota=True,user_id='8150984d14784bd6b6b17298cb178c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:39 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 1073741824 Jun 24 16:07:39 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95ac7a4-84d6-441c-b246-59ca5dedc638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95ac7a4-84d6-441c-b246-59ca5dedc638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6796694-c2c2-4cc2-b1c0-a265f686f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6796694-c2c2-4cc2-b1c0-a265f686f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4577f1d1-ffb3-4882-bf4a-674ef67c5444', 'volume_name': 'volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd52389a-88c2-4e43-9b5d-ac33aed4f23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd52389a-88c2-4e43-9b5d-ac33aed4f23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cde57e-de70-4eaa-9b9e-8ef70fd2e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Volume 4577f1d1-ffb3-4882-bf4a-674ef67c5444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444', 'volume_size': 1} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759fe5c4-2bca-4140-bb93-fd5d2a30592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efce29ab-597c-47d2-b2a3-6a2515aec910', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbb82c7-9f6c-426a-9d48-8d19770baaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume volume-efce29ab-597c-47d2-b2a3-6a2515aec910 (efce29ab-597c-47d2-b2a3-6a2515aec910): created successfully Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbb82c7-9f6c-426a-9d48-8d19770baaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (9a07a996-71c8-4190-8ab3-1a25281d2a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7a0693a9-c23f-48b2-a6c7-acc8f2c212a6 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created volume successfully. Jun 24 16:07:39 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4cb0a57e-c16c-4e00-9b76-1771fafefa5a" returned: 0 in 1.081s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "cinder-quobyte-4cb0a57e-c16c-4e00-9b76-1771fafefa5a" released by "delete_volume" :: held 2.353s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Created reservations ['a738c8ff-3ba5-413c-801a-2671dcd578e3', '23c82de8-9566-4cb9-978d-60e0aa26950b', 'fc4ce23a-ef54-4faa-8fb7-2f52b5ea46bf', 'e3148b04-d008-4ae5-99dc-d0e3df75c140'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:40 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.992s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:40 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:40 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:40 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 1073741824" returned: 0 in 1.145s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:40 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 Jun 24 16:07:40 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:40 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.761s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Deleted volume successfully. Jun 24 16:07:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6cf0c92-304f-4b18-9186-278c10bad08c tempest-VolumeQuotasNegativeTestJSON-364254337 None] Lock "cinder-4cb0a57e-c16c-4e00-9b76-1771fafefa5a-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:41 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064" returned: 0 in 0.769s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.467s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593741731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54fd7ea-1054-469a-85bf-e611789387ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:35Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Creating volume b54fd7ea-1054-469a-85bf-e611789387ba {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:41 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:41 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba 1073741824 Jun 24 16:07:41 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4272efcb-1411-4ac3-bedb-c2c2567563df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b1a541-ceb1-4e55-a52d-3998ca35c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:41 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 (a9a9948c-52bd-45b6-9031-3ea1e39ee064): created successfully Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b1a541-ceb1-4e55-a52d-3998ca35c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (789a4b81-e4c7-440e-8ff6-64ed43383b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-68dfffb9-4875-4c3d-a016-1fb110bfddcc tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created volume successfully. Jun 24 16:07:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-f21776b6-6d02-4ab0-ab76-04c3dc959307 req-69cebd59-999a-47f8-8782-00d70aaf7664 tempest-TestMinimumBasicScenario-124510732 None] Terminate volume connection completed successfully. Jun 24 16:07:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-f21776b6-6d02-4ab0-ab76-04c3dc959307 req-69cebd59-999a-47f8-8782-00d70aaf7664 tempest-TestMinimumBasicScenario-124510732 None] Deleting attachment 65ba6a95-49f1-46f2-a268-7935d4b5590f. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:07:42 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba 1073741824" returned: 0 in 0.932s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:42 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba Jun 24 16:07:42 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:43 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba" returned: 0 in 0.715s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.750s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243189408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86713b62a1be467ca485487792312443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:35Z,use_quota=True,user_id='f177623b37cf434a849df8aae251cdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Creating volume 881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:43 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a42610f-4d8b-4db7-b9c5-08c162cbb92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54fd7ea-1054-469a-85bf-e611789387ba', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:43 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f 1073741824 Jun 24 16:07:43 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533321f3-72a9-49a7-9527-ec8fbc2bda4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:43 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume volume-b54fd7ea-1054-469a-85bf-e611789387ba (b54fd7ea-1054-469a-85bf-e611789387ba): created successfully Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533321f3-72a9-49a7-9527-ec8fbc2bda4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (a6be8982-b07d-4d3b-b3a3-280793985e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d8665202-a098-4a8b-b2fe-85805f674fb4 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created volume successfully. Jun 24 16:07:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Acquiring lock "cinder-d369a79d-a43d-4780-9e2a-c9ee6ffc127d-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Lock "cinder-d369a79d-a43d-4780-9e2a-c9ee6ffc127d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Acquiring lock "cinder-quobyte-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Lock "cinder-quobyte-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefa8f9-017e-43cb-8ad2-eb10f8e6a40c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:44 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d Jun 24 16:07:44 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:44 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f 1073741824" returned: 0 in 1.106s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:44 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f Jun 24 16:07:44 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:45 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" returned: 0 in 0.883s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:45 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d Jun 24 16:07:45 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:45 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f" returned: 0 in 0.746s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.450s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1207290753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4577f1d1-ffb3-4882-bf4a-674ef67c5444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21669c2be04044019304ef00035dc23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:39Z,use_quota=True,user_id='8150984d14784bd6b6b17298cb178c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Creating volume 4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:45 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fbbd7a-9549-4ce6-92bc-2c45e4715eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445718f5-2678-458a-b43d-37eb2a3cee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:45 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 1073741824 Jun 24 16:07:45 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:45 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Volume volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f (881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f): created successfully Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445718f5-2678-458a-b43d-37eb2a3cee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Flow 'volume_create_manager' (bcbe12ab-77c2-438e-b1de-9f1efa7f7253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:45 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-29e64340-20c1-4692-a21b-a78957525980 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created volume successfully. Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-quobyte-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[365a5f15-8554-4267-88c4-760c7c6957e9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:45 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f Jun 24 16:07:45 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:45 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" returned: 0 in 0.899s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Lock "cinder-quobyte-d369a79d-a43d-4780-9e2a-c9ee6ffc127d" released by "delete_volume" :: held 1.832s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Created reservations ['01f52179-d8c6-4537-b5a4-7c1d5284bbfa', 'f68e01ed-1477-4d60-8b20-9af342a5d1e4', 'f6cbcb9f-6975-4bad-b68b-cb53341b2f86', '8ff8a5d0-6cc0-4b50-8d6a-d1a8412a2035'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:46 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:46 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:46 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 1073741824" returned: 0 in 1.095s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:46 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:07:46 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:46 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f" returned: 0 in 1.105s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:46 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f Jun 24 16:07:46 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:47 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.994s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Deleted volume successfully. Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-806e5893-cd4a-466f-a419-4aa418a9a98a tempest-TestMinimumBasicScenario-124510732 None] Lock "cinder-d369a79d-a43d-4780-9e2a-c9ee6ffc127d-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:47 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.806s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cde57e-de70-4eaa-9b9e-8ef70fd2e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c44a9b0-1c0e-4de2-b2d8-dd08d9d1bad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:47 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Volume volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 (4577f1d1-ffb3-4882-bf4a-674ef67c5444): created successfully Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c44a9b0-1c0e-4de2-b2d8-dd08d9d1bad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Flow 'volume_create_manager' (f7fb10c2-b758-41c5-be68-81fd8d85a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e68ec454-d3dc-48be-b74f-54ce7ae00f42 tempest-VolumesActionsTest-468242897 None] Created volume successfully. Jun 24 16:07:47 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f" returned: 0 in 0.791s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f" released by "delete_volume" :: held 1.968s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created reservations ['ec7e79dc-e052-4d36-a01f-2bbbd90e4672', '9e4009b7-d769-48c3-9001-9f475c76c04c', 'dcad47cb-ffc2-4f6e-a21d-b828e24ce71f', '242c32d2-c7e5-49cd-b3cd-86d67550c18c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:47 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:47 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:47 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Flow 'volume_create_manager' (d5f004e3-ec00-4293-b2bc-6637652392ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca1cf97-caac-41ae-a798-25aac9f11964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca1cf97-caac-41ae-a798-25aac9f11964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-969242747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae045e92-1107-4856-b8cb-c9710d147dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a375b56bc1421fadd4a7b93ee97931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:48Z,use_quota=True,user_id='c22b733207514a478a27b30cbc960ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2759406c-3052-40f5-9eac-fa33b354c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2759406c-3052-40f5-9eac-fa33b354c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a2b919-51b7-45c1-a7ce-9685cf2c4549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a2b919-51b7-45c1-a7ce-9685cf2c4549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae045e92-1107-4856-b8cb-c9710d147dee', 'volume_name': 'volume-ae045e92-1107-4856-b8cb-c9710d147dee', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a337a-9d25-4536-ab2d-c38cf35e7e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a337a-9d25-4536-ab2d-c38cf35e7e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dac2b8b-bce7-46fb-af05-d55de6c5986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Volume ae045e92-1107-4856-b8cb-c9710d147dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae045e92-1107-4856-b8cb-c9710d147dee', 'volume_size': 1} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-969242747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae045e92-1107-4856-b8cb-c9710d147dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a375b56bc1421fadd4a7b93ee97931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:07:48Z,use_quota=True,user_id='c22b733207514a478a27b30cbc960ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Creating volume ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:07:48 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:48 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee 1073741824 Jun 24 16:07:48 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:48 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.948s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:48 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Deleted volume successfully. Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-de8e4211-c5d4-426a-b712-9aed8a1ef72a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-881aa1b4-d6a2-4d78-a96a-4ffd10b85b1f-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-b54fd7ea-1054-469a-85bf-e611789387ba-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-b54fd7ea-1054-469a-85bf-e611789387ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-quobyte-b54fd7ea-1054-469a-85bf-e611789387ba" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-b54fd7ea-1054-469a-85bf-e611789387ba" acquired by "delete_volume" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:49 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac1970-2a62-4f44-b2e8-ae1c0c7558ad]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:49 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba Jun 24 16:07:49 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:49 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee 1073741824" returned: 0 in 1.110s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:49 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee Jun 24 16:07:49 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:50 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba" returned: 0 in 1.070s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:50 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba Jun 24 16:07:50 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:50 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee" returned: 0 in 0.898s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dac2b8b-bce7-46fb-af05-d55de6c5986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae045e92-1107-4856-b8cb-c9710d147dee', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d865ad1-b019-4904-9a0c-9c78c4391574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:07:50 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Volume volume-ae045e92-1107-4856-b8cb-c9710d147dee (ae045e92-1107-4856-b8cb-c9710d147dee): created successfully Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d865ad1-b019-4904-9a0c-9c78c4391574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Flow 'volume_create_manager' (d5f004e3-ec00-4293-b2bc-6637652392ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:07:50 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b6e92551-1a10-47fc-97b0-f22e54a9931d tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Created volume successfully. Jun 24 16:07:50 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b54fd7ea-1054-469a-85bf-e611789387ba" returned: 0 in 0.679s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-b54fd7ea-1054-469a-85bf-e611789387ba" released by "delete_volume" :: held 1.809s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created reservations ['e5c9fc74-2ca6-4593-9495-9ecde3805787', '78d1164c-4c94-4d8a-a35d-9ec5afeb85f2', '6b60f47c-811a-42a9-83c4-de1708a9c62d', '6b93619c-4b74-4773-923f-8d7448a951b8'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:51 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:51 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-a9a9948c-52bd-45b6-9031-3ea1e39ee064-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-a9a9948c-52bd-45b6-9031-3ea1e39ee064-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Creating offline snapshot 4acdb166-88d2-4f36-bb41-33cbf7995467 of volume ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-quobyte-a9a9948c-52bd-45b6-9031-3ea1e39ee064" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe66fd-366f-41a9-a6e7-3966d5b42485]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-a9a9948c-52bd-45b6-9031-3ea1e39ee064" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c19a6-ed2a-41bd-96f0-93398d94cf63]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:51 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee Jun 24 16:07:51 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:51 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 Jun 24 16:07:51 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:51 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.761s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:51 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Deleted volume successfully. Jun 24 16:07:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c2eb2c6c-9e31-4fbe-ab6f-f1b581afe3c9 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-b54fd7ea-1054-469a-85bf-e611789387ba-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:52 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee" returned: 0 in 0.780s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:52 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 1G Jun 24 16:07:52 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:52 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064" returned: 0 in 0.820s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:52 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064 Jun 24 16:07:52 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:52 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a9a9948c-52bd-45b6-9031-3ea1e39ee064" returned: 0 in 0.670s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-a9a9948c-52bd-45b6-9031-3ea1e39ee064" released by "delete_volume" :: held 1.540s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:52 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 1G" returned: 0 in 0.833s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae045e92-1107-4856-b8cb-c9710d147dee -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:52 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created reservations ['1503c9ef-f2ae-4513-9df1-ab928d8a1ebb', '3c1d605e-7da8-480a-a1b3-4db801754de9', '8fe9e546-a4f3-4aa6-8862-e27ce89d722c', '799dccc2-d43b-434a-a62a-0778ab98fd06'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:53 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae045e92-1107-4856-b8cb-c9710d147dee -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 Jun 24 16:07:53 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:53 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:53 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-efce29ab-597c-47d2-b2a3-6a2515aec910-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-efce29ab-597c-47d2-b2a3-6a2515aec910-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-quobyte-efce29ab-597c-47d2-b2a3-6a2515aec910" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-efce29ab-597c-47d2-b2a3-6a2515aec910" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[45899872-1095-489f-ad2a-e3dbe19dfbdb]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:53 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 Jun 24 16:07:53 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:53 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.714s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Deleted volume successfully. Jun 24 16:07:53 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae045e92-1107-4856-b8cb-c9710d147dee -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467" returned: 0 in 0.832s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:53 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 is being set with open permissions: ugo+rw Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-08d3c4ad-f7b0-4cc7-a893-aaebab39afa3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-a9a9948c-52bd-45b6-9031-3ea1e39ee064-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:53 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 Jun 24 16:07:53 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:54 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910" returned: 0 in 0.951s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:54 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467" returned: 0 in 0.760s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:54 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910 Jun 24 16:07:54 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:54 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info Jun 24 16:07:54 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:55 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info" returned: 0 in 0.936s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:55 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info is being set with open permissions: ugo+rw Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:55 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-efce29ab-597c-47d2-b2a3-6a2515aec910" returned: 0 in 1.043s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-efce29ab-597c-47d2-b2a3-6a2515aec910" released by "delete_volume" :: held 2.042s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:55 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info Jun 24 16:07:55 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created reservations ['6d84a76f-b5c0-426d-948e-9ef3c4d7b8ea', '48c5409c-82e0-4fa2-8dfa-cea01d536d83', '4d22efc0-73b9-4c79-aeb2-e10113a5a7e1', '27078cb7-6f6b-449b-a6f6-6f1aedd2a470'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:55 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:55 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:56 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.info" returned: 0 in 0.908s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.221s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:56 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-59e9e05c-f655-416b-a9f9-97fe0582ae83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Create snapshot completed successfully Jun 24 16:07:56 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.998s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:56 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:07:56 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Deleted volume successfully. Jun 24 16:07:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cd39241a-e703-4795-8a1e-12102fe91b0a tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-efce29ab-597c-47d2-b2a3-6a2515aec910-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-7335bb1c-2528-4b6d-8c1e-e0fea268ba85-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-7335bb1c-2528-4b6d-8c1e-e0fea268ba85-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-quobyte-7335bb1c-2528-4b6d-8c1e-e0fea268ba85" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-7335bb1c-2528-4b6d-8c1e-e0fea268ba85" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:57 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc0199-8443-42a8-9a9e-6d2f3bec36b6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:57 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 Jun 24 16:07:57 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:58 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85" returned: 0 in 0.895s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:58 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85 Jun 24 16:07:58 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "cinder-4acdb166-88d2-4f36-bb41-33cbf7995467-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-4acdb166-88d2-4f36-bb41-33cbf7995467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "cinder-quobyte-ae045e92-1107-4856-b8cb-c9710d147dee" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-quobyte-ae045e92-1107-4856-b8cb-c9710d147dee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "cinder-quobyte-4acdb166-88d2-4f36-bb41-33cbf7995467" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-quobyte-4acdb166-88d2-4f36-bb41-33cbf7995467" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Deleting offline snapshot 4acdb166-88d2-4f36-bb41-33cbf7995467 of volume ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] snapshot_file for this snap is: volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c0d0f0-d8bb-4ef7-a734-52fbd55447f2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:58 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 Jun 24 16:07:58 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:58 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-7335bb1c-2528-4b6d-8c1e-e0fea268ba85" returned: 0 in 0.844s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-7335bb1c-2528-4b6d-8c1e-e0fea268ba85" released by "delete_volume" :: held 1.808s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=133,cinder:SELECT=95,cinder:INSERT=31,cinder:DELETE=12 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=137,cinder:SELECT=103,cinder:INSERT=28,cinder:DELETE=9 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:07:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created reservations ['d45c8d22-8552-4182-b77b-a42932e07e87', 'dfdef099-fff8-4b0b-b7cd-d90cb06a0539', 'dbbad024-e13f-4f95-b6af-6dd10400f08b', 'e03d4d8c-5df1-4346-8982-02fc6b3a1779'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:59 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:07:59 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:59 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467" returned: 0 in 0.989s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae045e92-1107-4856-b8cb-c9710d147dee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e426f63-d778-4a22-b68b-d33018a39a7d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-31bbcbc6-db93-4745-917e-7f14b4945700-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-31bbcbc6-db93-4745-917e-7f14b4945700-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:59 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee Jun 24 16:07:59 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "cinder-quobyte-31bbcbc6-db93-4745-917e-7f14b4945700" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-31bbcbc6-db93-4745-917e-7f14b4945700" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5d0e2-2824-4551-ab25-6e1c376a7466]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:07:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:07:59 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 Jun 24 16:07:59 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:00 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.041s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:00 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Deleted volume successfully. Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69cc1506-1f6b-4200-b2bd-af39bfdfc3c3 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-7335bb1c-2528-4b6d-8c1e-e0fea268ba85-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:00 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee" returned: 0 in 1.205s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:00 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 Jun 24 16:08:00 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:00 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700" returned: 0 in 1.000s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:00 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700 Jun 24 16:08:00 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:01 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467" returned: 0 in 0.899s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:01 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-31bbcbc6-db93-4745-917e-7f14b4945700" returned: 0 in 0.821s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:01 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467 Jun 24 16:08:01 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-quobyte-31bbcbc6-db93-4745-917e-7f14b4945700" released by "delete_volume" :: held 1.897s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Created reservations ['5612523f-a332-48c4-9afd-f143a8175fe9', 'ccfc1320-60e0-464a-8c39-af46d769cb90', 'f1623f43-3ff7-4e48-aff2-3ec12f4ce281', '90511750-0481-4749-b521-64de7253cda2'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:01 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:01 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:02 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee.4acdb166-88d2-4f36-bb41-33cbf7995467" returned: 0 in 1.005s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-quobyte-4acdb166-88d2-4f36-bb41-33cbf7995467" released by "_delete_snapshot" :: held 4.292s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-quobyte-ae045e92-1107-4856-b8cb-c9710d147dee" released by "delete_snapshot" :: held 4.327s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:02 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.037s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Deleted volume successfully. Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Created reservations ['d5f99fef-5f82-474d-a509-10f617abc836', '5e3078f2-652b-494c-bd5d-69e90fbb210a', 'a921cc03-0be7-444c-ab5f-2070dfa3d117', '28bc472f-c29d-41db-909d-08e3bb3da259'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e12866ef-650f-4900-86d0-2710442b3454 tempest-CreateVolumesFromSourceVolumeTest-522135307 None] Lock "cinder-31bbcbc6-db93-4745-917e-7f14b4945700-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Delete snapshot completed successfully. Jun 24 16:08:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-648b0345-d2c4-4134-98e4-987e600a4961 tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-4acdb166-88d2-4f36-bb41-33cbf7995467-delete_snapshot" released by "delete_snapshot" :: held 4.716s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "cinder-ae045e92-1107-4856-b8cb-c9710d147dee-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-ae045e92-1107-4856-b8cb-c9710d147dee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "cinder-quobyte-ae045e92-1107-4856-b8cb-c9710d147dee" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-quobyte-ae045e92-1107-4856-b8cb-c9710d147dee" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f5cd1-4f4e-41cc-b69b-f2397aad5bfa]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:04 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee Jun 24 16:08:04 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:05 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee" returned: 0 in 1.227s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:05 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee Jun 24 16:08:05 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:06 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ae045e92-1107-4856-b8cb-c9710d147dee" returned: 0 in 1.300s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-quobyte-ae045e92-1107-4856-b8cb-c9710d147dee" released by "delete_volume" :: held 2.652s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Created reservations ['d44b55cf-929d-40b2-9c89-1ae143afe03e', '385e820c-7e46-47c2-bb46-c7b97d5d9103', '1fb95915-9065-4eea-839b-7a1b0ea9397e', 'c52f823a-db66-40b2-b8a0-7f16b65ec692'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:06 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:06 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Flow 'volume_create_manager' (c1324700-7225-458f-adbc-90089f3d34b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b3ba79-b011-400d-a1e2-8e755f383314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b3ba79-b011-400d-a1e2-8e755f383314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1588117417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6c3bf3bf994c2e9e3b2b89ff141f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:07Z,use_quota=True,user_id='dd6a37c8d66641eb9ed3bde21d730644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917b4072-1eac-4555-9eb5-8e49ac319d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917b4072-1eac-4555-9eb5-8e49ac319d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426419ed-a174-4e3d-b60f-e5d2208fde14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426419ed-a174-4e3d-b60f-e5d2208fde14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1', 'volume_name': 'volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165331fc-7fb5-4752-a8e1-709d4c69298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165331fc-7fb5-4752-a8e1-709d4c69298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e57b8f-16bd-4012-898e-5d7f052887df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Volume a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1', 'volume_size': 1} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1588117417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6c3bf3bf994c2e9e3b2b89ff141f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:07Z,use_quota=True,user_id='dd6a37c8d66641eb9ed3bde21d730644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Creating volume a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:07 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:07 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 1073741824 Jun 24 16:08:07 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0726c914-b80c-4ef6-99a8-7572ffa3694e tempest-VolumesActionsTest-468242897 None] Acquiring lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444" by "attach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0726c914-b80c-4ef6-99a8-7572ffa3694e tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444" acquired by "attach_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0726c914-b80c-4ef6-99a8-7572ffa3694e tempest-VolumesActionsTest-468242897 None] Attaching volume 4577f1d1-ffb3-4882-bf4a-674ef67c5444 to instance ee204156-2430-430a-99b1-69303f953171 at mountpoint /dev/vdb on host None. Jun 24 16:08:08 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.191s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Deleted volume successfully. Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c5148a31-d25f-40df-94b1-eea920a231fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1938537241 None] Lock "cinder-ae045e92-1107-4856-b8cb-c9710d147dee-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0726c914-b80c-4ef6-99a8-7572ffa3694e tempest-VolumesActionsTest-468242897 None] Attach volume completed successfully. Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0726c914-b80c-4ef6-99a8-7572ffa3694e tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444" released by "attach_volume" :: held 0.255s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5dda5113-f1d4-465f-965b-8d79af023b79 tempest-VolumesActionsTest-468242897 None] Acquiring lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-detach_volume" by "detach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5dda5113-f1d4-465f-965b-8d79af023b79 tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5dda5113-f1d4-465f-965b-8d79af023b79 tempest-VolumesActionsTest-468242897 None] Detaching volume 4577f1d1-ffb3-4882-bf4a-674ef67c5444 from instance ee204156-2430-430a-99b1-69303f953171. Jun 24 16:08:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5dda5113-f1d4-465f-965b-8d79af023b79 tempest-VolumesActionsTest-468242897 None] Detach volume completed successfully. Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5dda5113-f1d4-465f-965b-8d79af023b79 tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:08 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 1073741824" returned: 0 in 1.303s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:09 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:09 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:09 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 0.853s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e57b8f-16bd-4012-898e-5d7f052887df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9493f3-3a43-479e-b4fb-30ef5054403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:09 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Volume volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 (a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1): created successfully Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9493f3-3a43-479e-b4fb-30ef5054403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Flow 'volume_create_manager' (c1324700-7225-458f-adbc-90089f3d34b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d3349ae1-41fc-4975-b5a8-1f847b8c0af2 tempest-VolumeDependencyTests-221896923 None] Created volume successfully. Jun 24 16:08:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Creating offline snapshot 8e3f07cf-5c89-4acf-8c6a-837f38d40a38 of volume a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:08:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6757ee-2843-488e-afee-1ac7aa18e625]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:11 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:11 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:12 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 1.065s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:12 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 1G Jun 24 16:08:12 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (53202e04-a2ee-4530-bfbc-034f1722f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fea7f8-8e6d-478a-bc19-2158eb0c468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fea7f8-8e6d-478a-bc19-2158eb0c468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203241896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4563ca6d-8ed1-476c-9a81-b936ff76e177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:13Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf94d9-dd5c-4c15-877f-76c8d552ddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf94d9-dd5c-4c15-877f-76c8d552ddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e207fe61-9d3f-4f95-b107-c0d5fc15df77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e207fe61-9d3f-4f95-b107-c0d5fc15df77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4563ca6d-8ed1-476c-9a81-b936ff76e177', 'volume_name': 'volume-4563ca6d-8ed1-476c-9a81-b936ff76e177', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3343674d-37ee-4f23-9383-372321fc488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3343674d-37ee-4f23-9383-372321fc488e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565378dd-4c80-49bd-8c85-ee2f423f47d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:13 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume 4563ca6d-8ed1-476c-9a81-b936ff76e177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4563ca6d-8ed1-476c-9a81-b936ff76e177', 'volume_size': 1} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:13 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 1G" returned: 0 in 1.145s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:13 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 Jun 24 16:08:13 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:14 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:14 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 is being set with open permissions: ugo+rw Jun 24 16:08:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:14 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 Jun 24 16:08:14 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:14 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38" returned: 0 in 0.650s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:14 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info Jun 24 16:08:14 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:15 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info" returned: 0 in 0.684s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:15 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info is being set with open permissions: ugo+rw Jun 24 16:08:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:15 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info Jun 24 16:08:15 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Flow 'volume_create_manager' (8bd5e9fe-a2cc-4a46-a329-d83ac98af8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0987cb-65a0-4736-85e4-4a6905193a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0987cb-65a0-4736-85e4-4a6905193a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1802860717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab33471-c26b-4a1d-87c7-2aa2231aff7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443358d587bf4cb0a9d2830411d6911f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:16Z,use_quota=True,user_id='fd204b2e0fa44b12b6ecaf212a877ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be4c588-fc29-4213-a933-2801b4d2c37a),volume_type_id=8be4c588-fc29-4213-a933-2801b4d2c37a)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24923e4c-db02-49f1-883a-828fdf570edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24923e4c-db02-49f1-883a-828fdf570edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a33c4a-331d-49bf-885a-d49d3be20b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a33c4a-331d-49bf-885a-d49d3be20b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab33471-c26b-4a1d-87c7-2aa2231aff7a', 'volume_name': 'volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393ad23d-4318-4e43-98b7-e809a0dd621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393ad23d-4318-4e43-98b7-e809a0dd621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582e8e50-9241-423a-abe2-1ccdb8e44ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:16 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Volume 0ab33471-c26b-4a1d-87c7-2aa2231aff7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a', 'volume_size': 1} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:16 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.info" returned: 0 in 0.705s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.115s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.041s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1203241896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4563ca6d-8ed1-476c-9a81-b936ff76e177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:13Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating volume 4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:16 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:16 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 1073741824 Jun 24 16:08:16 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-689eeb85-92a9-4639-86da-14df4a240a88 tempest-VolumeDependencyTests-221896923 None] Create snapshot completed successfully Jun 24 16:08:17 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 1073741824" returned: 0 in 0.875s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:17 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 Jun 24 16:08:17 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:17 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177" returned: 0 in 0.671s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1802860717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab33471-c26b-4a1d-87c7-2aa2231aff7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443358d587bf4cb0a9d2830411d6911f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:16Z,use_quota=True,user_id='fd204b2e0fa44b12b6ecaf212a877ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8be4c588-fc29-4213-a933-2801b4d2c37a),volume_type_id=8be4c588-fc29-4213-a933-2801b4d2c37a)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Creating volume 0ab33471-c26b-4a1d-87c7-2aa2231aff7a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:17 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:17 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a 1073741824 Jun 24 16:08:17 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565378dd-4c80-49bd-8c85-ee2f423f47d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4563ca6d-8ed1-476c-9a81-b936ff76e177', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b112ff4c-361b-447f-94b2-550e81a7ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:17 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 (4563ca6d-8ed1-476c-9a81-b936ff76e177): created successfully Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b112ff4c-361b-447f-94b2-550e81a7ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (53202e04-a2ee-4530-bfbc-034f1722f08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4ac8ae14-c1d4-44ca-ae7b-5b4db6b7609b tempest-CreateVolumesFromSnapshotTest-966698414 None] Created volume successfully. Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Flow 'volume_create_manager' (79e6895b-b9d9-4dad-9a38-a53f7623f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5371a4-f078-4927-b060-9e0e1079aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5371a4-f078-4927-b060-9e0e1079aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2082692239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd44a132-ae25-4bd1-9489-f5708c61594f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e6c3bf3bf994c2e9e3b2b89ff141f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e3f07cf-5c89-4acf-8c6a-837f38d40a38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:18Z,use_quota=True,user_id='dd6a37c8d66641eb9ed3bde21d730644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e5aa98-bd86-4ba5-97af-e994ba1e3057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e5aa98-bd86-4ba5-97af-e994ba1e3057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1332c860-7df8-49ea-b1fb-399937f76b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1332c860-7df8-49ea-b1fb-399937f76b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd44a132-ae25-4bd1-9489-f5708c61594f', 'volume_name': 'volume-fd44a132-ae25-4bd1-9489-f5708c61594f', 'volume_size': 1, 'snapshot_id': '8e3f07cf-5c89-4acf-8c6a-837f38d40a38'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc0163b-1cbe-4645-8a89-e78e2a66808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc0163b-1cbe-4645-8a89-e78e2a66808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf12ed12-2a53-4721-92d8-1db2ebd3ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:18 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Volume fd44a132-ae25-4bd1-9489-f5708c61594f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd44a132-ae25-4bd1-9489-f5708c61594f', 'volume_size': 1, 'snapshot_id': '8e3f07cf-5c89-4acf-8c6a-837f38d40a38'} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:18 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a 1073741824" returned: 0 in 1.021s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:18 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a Jun 24 16:08:18 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:19 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a" returned: 0 in 0.688s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.437s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-quobyte-8e3f07cf-5c89-4acf-8c6a-837f38d40a38-fd44a132-ae25-4bd1-9489-f5708c61594f" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582e8e50-9241-423a-abe2-1ccdb8e44ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b8417e-5da7-4363-80ce-132060213043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-8e3f07cf-5c89-4acf-8c6a-837f38d40a38-fd44a132-ae25-4bd1-9489-f5708c61594f" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Creating volume fd44a132-ae25-4bd1-9489-f5708c61594f from snapshot 8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-quobyte-fd44a132-ae25-4bd1-9489-f5708c61594f" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:19 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Volume volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a (0ab33471-c26b-4a1d-87c7-2aa2231aff7a): created successfully Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b8417e-5da7-4363-80ce-132060213043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Flow 'volume_create_manager' (8bd5e9fe-a2cc-4a46-a329-d83ac98af8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-fd44a132-ae25-4bd1-9489-f5708c61594f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] snapshot: 8e3f07cf-5c89-4acf-8c6a-837f38d40a38, volume: fd44a132-ae25-4bd1-9489-f5708c61594f, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:08:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-543425c6-233b-4be8-b862-620146b82db9 tempest-VolumeTypesAccessTest-1464020074 None] Created volume successfully. Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6412b754-bf97-45e6-8960-82a358c54d2c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:19 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 Jun 24 16:08:19 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Acquiring lock "cinder-0ab33471-c26b-4a1d-87c7-2aa2231aff7a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Lock "cinder-0ab33471-c26b-4a1d-87c7-2aa2231aff7a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Acquiring lock "cinder-quobyte-0ab33471-c26b-4a1d-87c7-2aa2231aff7a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Lock "cinder-quobyte-0ab33471-c26b-4a1d-87c7-2aa2231aff7a" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e153c8d-91e7-41bd-b360-4c810419772c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:20 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a Jun 24 16:08:20 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:20 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38" returned: 0 in 0.806s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa422cb-5cfc-48b2-a54b-c1062f938d2a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:20 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:20 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:21 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:21 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a Jun 24 16:08:21 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:21 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 0.785s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:21 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f Jun 24 16:08:21 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:21 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ab33471-c26b-4a1d-87c7-2aa2231aff7a" returned: 0 in 0.652s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Lock "cinder-quobyte-0ab33471-c26b-4a1d-87c7-2aa2231aff7a" released by "delete_volume" :: held 1.476s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:21 devstack cinder-volume[93867]: WARNING cinder.quota [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1464408893 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1464408893, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:08:21 devstack cinder-volume[93867]: WARNING cinder.quota [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1464408893 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1464408893, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:08:21 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Created reservations ['98c3a090-9969-4e88-a4d8-be693ec2052b', 'b0528bb5-7939-45eb-b609-04f62b6fe4fb', 'b27b1c5a-6f2f-4ccb-99a5-ae3d76bbcc9d', '8eff3594-e389-422e-b407-cddf239262f5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:22 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:22 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:23 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.494s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:23 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Deleted volume successfully. Jun 24 16:08:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6e7a887-5b03-4a79-b4a4-b705253e0249 tempest-VolumeTypesAccessTest-1464020074 None] Lock "cinder-0ab33471-c26b-4a1d-87c7-2aa2231aff7a-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:27 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f" returned: 0 in 6.280s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec4a14b-2b73-4378-8ef7-1663802597ea]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:27 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:27 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:28 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 1.115s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:28 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:08:28 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Converted 1024.00 MB image at 163.04 MB/s Jun 24 16:08:28 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f is being set with open permissions: ugo+rw Jun 24 16:08:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:28 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f Jun 24 16:08:28 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:29 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f" returned: 0 in 0.694s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-fd44a132-ae25-4bd1-9489-f5708c61594f" released by "_copy_volume_from_snapshot" :: held 9.798s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-8e3f07cf-5c89-4acf-8c6a-837f38d40a38-fd44a132-ae25-4bd1-9489-f5708c61594f" released by "_create_volume_from_snapshot" :: held 9.853s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.886s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.813s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating offline snapshot c0a34816-e1f9-4152-9f2f-15d3daf28480 of volume 4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf12ed12-2a53-4721-92d8-1db2ebd3ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd44a132-ae25-4bd1-9489-f5708c61594f', 'volume_size': 1, 'snapshot_id': '8e3f07cf-5c89-4acf-8c6a-837f38d40a38'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa73625-55ce-43f9-84c6-51237fac98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77f58a-e150-4dd2-8ea9-74e1388ce9d2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:29 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Volume volume-fd44a132-ae25-4bd1-9489-f5708c61594f (fd44a132-ae25-4bd1-9489-f5708c61594f): created successfully Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa73625-55ce-43f9-84c6-51237fac98c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Flow 'volume_create_manager' (79e6895b-b9d9-4dad-9a38-a53f7623f425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:29 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b261c716-8194-4756-bfbe-c63de7d30591 tempest-VolumeDependencyTests-221896923 None] Created volume successfully. Jun 24 16:08:29 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 Jun 24 16:08:29 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-8e3f07cf-5c89-4acf-8c6a-837f38d40a38-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-8e3f07cf-5c89-4acf-8c6a-837f38d40a38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-quobyte-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-quobyte-8e3f07cf-5c89-4acf-8c6a-837f38d40a38" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-8e3f07cf-5c89-4acf-8c6a-837f38d40a38" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Deleting offline snapshot 8e3f07cf-5c89-4acf-8c6a-837f38d40a38 of volume a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] snapshot_file for this snap is: volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f366b1-aed5-4c75-a2e1-419976dfa6f0]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:30 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177" returned: 0 in 0.911s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:30 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 1G Jun 24 16:08:30 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:30 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 Jun 24 16:08:30 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:31 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38" returned: 0 in 0.970s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:08:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0623739f-9d3b-4037-92f3-9dba760f28b4]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:31 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 1G" returned: 0 in 0.986s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:31 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 Jun 24 16:08:31 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:31 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:31 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:32 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480" returned: 0 in 0.740s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:32 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 is being set with open permissions: ugo+rw Jun 24 16:08:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:32 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 Jun 24 16:08:32 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:32 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 0.915s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:32 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 Jun 24 16:08:32 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:32 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480" returned: 0 in 0.712s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:33 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info Jun 24 16:08:33 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:33 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38" returned: 0 in 0.816s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:33 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38 Jun 24 16:08:33 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Flow 'volume_create_manager' (4fad6eef-7f11-4b9f-8bc5-3364dab82fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a058980a-f67f-4629-b058-768986c73f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:33 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info" returned: 0 in 0.817s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:33 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info is being set with open permissions: ugo+rw Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a058980a-f67f-4629-b058-768986c73f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-843064991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475bab9e-44f5-4c84-9bba-1672bbd71116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fd9a4d454e455c8711a8f8f3315b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:34Z,use_quota=True,user_id='ad0d23762f32497da1b113c739ffa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:33 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36331040-06fc-418d-a5c7-5ff73c8e0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:33 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36331040-06fc-418d-a5c7-5ff73c8e0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88642f4a-a467-41e5-8933-a79a7b3ad3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88642f4a-a467-41e5-8933-a79a7b3ad3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '475bab9e-44f5-4c84-9bba-1672bbd71116', 'volume_name': 'volume-475bab9e-44f5-4c84-9bba-1672bbd71116', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ac7bb7-5638-47dc-bcdf-5eed2cbe6c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ac7bb7-5638-47dc-bcdf-5eed2cbe6c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50f4c30-09a7-4d8e-be46-1e374a91795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Volume 475bab9e-44f5-4c84-9bba-1672bbd71116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-475bab9e-44f5-4c84-9bba-1672bbd71116', 'volume_size': 1} Jun 24 16:08:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:34 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1.8e3f07cf-5c89-4acf-8c6a-837f38d40a38" returned: 0 in 0.792s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-8e3f07cf-5c89-4acf-8c6a-837f38d40a38" released by "_delete_snapshot" :: held 3.643s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" released by "delete_snapshot" :: held 3.677s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Created reservations ['193a4afb-7d14-45e5-8ebc-5fc602cccc28', '00076a17-a38b-441a-a7f9-b10b70dfc750', '0861b936-7719-4fe5-a58a-c2006a6de9f0', '58977748-e021-4c9c-9e6a-75832c4bc0ee'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Delete snapshot completed successfully. Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1965d82-cffd-48a5-84b1-27099f69c5a1 tempest-VolumeDependencyTests-221896923 None] Lock "cinder-8e3f07cf-5c89-4acf-8c6a-837f38d40a38-delete_snapshot" released by "delete_snapshot" :: held 3.840s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Lock "cinder-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:34 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.info" returned: 0 in 0.968s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.291s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-843064991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475bab9e-44f5-4c84-9bba-1672bbd71116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fd9a4d454e455c8711a8f8f3315b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:34Z,use_quota=True,user_id='ad0d23762f32497da1b113c739ffa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Creating volume 475bab9e-44f5-4c84-9bba-1672bbd71116 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:34 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-quobyte-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:34 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 1073741824 Jun 24 16:08:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:34 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-23018a4c-8dfc-4d5f-9e60-c8eaad6b1cb9 tempest-CreateVolumesFromSnapshotTest-966698414 None] Create snapshot completed successfully Jun 24 16:08:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155ad3b-dd8d-4184-9030-3bdf9fa7befc]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:35 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:35 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:36 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 1.049s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:36 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 1073741824" returned: 0 in 1.244s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:36 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1 Jun 24 16:08:36 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:36 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 Jun 24 16:08:36 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (b7063029-9e93-4865-94f6-7be25c7aac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57b9579-1346-48a3-82b0-0b85e9f46df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57b9579-1346-48a3-82b0-0b85e9f46df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-399870221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297305fa-33b7-4151-80e4-c556f75ccfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:36Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec20b1-89bc-4f6f-a447-74f918613238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec20b1-89bc-4f6f-a447-74f918613238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c729fd7f-c08c-4788-8d8e-3366dc6d093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c729fd7f-c08c-4788-8d8e-3366dc6d093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297305fa-33b7-4151-80e4-c556f75ccfb2', 'volume_name': 'volume-297305fa-33b7-4151-80e4-c556f75ccfb2', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e75593-c8d3-4b16-a726-f953dfd701dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e75593-c8d3-4b16-a726-f953dfd701dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f613d082-e157-4e51-8842-1aa7f8f5e724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:36 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume 297305fa-33b7-4151-80e4-c556f75ccfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297305fa-33b7-4151-80e4-c556f75ccfb2', 'volume_size': 1} Jun 24 16:08:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:37 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" returned: 0 in 1.289s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1" released by "delete_volume" :: held 2.490s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:37 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116" returned: 0 in 1.294s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] <== create_volume: return (2597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.603s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-399870221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297305fa-33b7-4151-80e4-c556f75ccfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:36Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating volume 297305fa-33b7-4151-80e4-c556f75ccfb2 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:37 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50f4c30-09a7-4d8e-be46-1e374a91795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475bab9e-44f5-4c84-9bba-1672bbd71116', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fca423-912e-4613-b36a-85909ba3e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:37 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 1073741824 Jun 24 16:08:37 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Volume volume-475bab9e-44f5-4c84-9bba-1672bbd71116 (475bab9e-44f5-4c84-9bba-1672bbd71116): created successfully Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fca423-912e-4613-b36a-85909ba3e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Flow 'volume_create_manager' (4fad6eef-7f11-4b9f-8bc5-3364dab82fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4d5b7a0d-8fc9-421a-bef7-3325e3a21769 tempest-VolumesListAdminTestJSON-381104546 None] Created volume successfully. Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Created reservations ['6fe29009-09cd-481e-9829-b07823cf0daf', '2864f7d3-b289-425a-9deb-30c9c6fe5380', '767a13e9-b786-4279-9a86-3a210cf94c79', 'f82ce863-d434-477f-a251-a603899bd394'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (583b7325-7d77-4afd-b176-8fa08a84282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b17d15-a3b5-4b95-9823-a72aa3200515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b17d15-a3b5-4b95-9823-a72aa3200515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435008797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4603da63-0c1b-40b9-9c2a-bb0c3e0712e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:38Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38171b24-e6e2-46a4-bff2-751985077d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38171b24-e6e2-46a4-bff2-751985077d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e77445-343d-459b-b82f-877fea74c297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e77445-343d-459b-b82f-877fea74c297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4603da63-0c1b-40b9-9c2a-bb0c3e0712e5', 'volume_name': 'volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331476c3-3af1-4242-b4dc-d45f4d105d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331476c3-3af1-4242-b4dc-d45f4d105d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e14067e-3a42-4b06-bd47-8aebe8052882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:37 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume 4603da63-0c1b-40b9-9c2a-bb0c3e0712e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5', 'volume_size': 1} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:38 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:38 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (30530a7a-5141-46e3-9ca4-0dd53a842c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18653db-6ad4-457e-aaeb-24062cc41124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18653db-6ad4-457e-aaeb-24062cc41124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378393534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ff4440-0d87-4085-930a-ce806189276b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:38Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54209db2-3876-4f81-a7ce-5a7072d9e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54209db2-3876-4f81-a7ce-5a7072d9e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc11789-f056-4b0e-a54a-da23b487a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc11789-f056-4b0e-a54a-da23b487a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ff4440-0d87-4085-930a-ce806189276b', 'volume_name': 'volume-66ff4440-0d87-4085-930a-ce806189276b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32f445f-f620-47f0-b3de-0b133fc21688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32f445f-f620-47f0-b3de-0b133fc21688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d84e050-bbd9-463d-bcad-27b4439748cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:38 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume 66ff4440-0d87-4085-930a-ce806189276b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ff4440-0d87-4085-930a-ce806189276b', 'volume_size': 1} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-fd44a132-ae25-4bd1-9489-f5708c61594f-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Lock "cinder-fd44a132-ae25-4bd1-9489-f5708c61594f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (b3d50868-efd0-459e-acfa-9ac77f01393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbf152c-a278-430d-8e7b-0c46299042f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Acquiring lock "cinder-quobyte-fd44a132-ae25-4bd1-9489-f5708c61594f" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbf152c-a278-430d-8e7b-0c46299042f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47381555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c8c415-e40d-4b1e-8ec3-0074c989c87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:39Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255de5d3-6051-4379-9515-a8bf014612c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:39 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255de5d3-6051-4379-9515-a8bf014612c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de1f5de-da07-4080-a04e-d2c62afa2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de1f5de-da07-4080-a04e-d2c62afa2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c8c415-e40d-4b1e-8ec3-0074c989c87c', 'volume_name': 'volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d49353-4493-40cb-9ce2-ef638b2d5038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d49353-4493-40cb-9ce2-ef638b2d5038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08b38f8-3176-4d04-ad22-ec616257526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume c6c8c415-e40d-4b1e-8ec3-0074c989c87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c', 'volume_size': 1} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-fd44a132-ae25-4bd1-9489-f5708c61594f" acquired by "delete_volume" :: waited 0.193s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:39 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[910dc3df-8754-4007-88ad-8b6e438528ab]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 1073741824" returned: 0 in 1.843s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:39 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.382s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:39 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Deleted volume successfully. Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-93135be8-840a-4973-9a41-b4789df464ac tempest-VolumesActionsTest-468242897 None] Acquiring lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444" by "attach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-bedbb2e2-1bfa-40bf-b644-8ee9a6da6d2e tempest-VolumeDependencyTests-221896923 None] Lock "cinder-a2e9786d-7ea0-4167-9c07-68c7fc4e2fd1-delete_volume" released by "delete_volume" :: held 4.745s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-93135be8-840a-4973-9a41-b4789df464ac tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444" acquired by "attach_volume" :: waited 0.120s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:39 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 Jun 24 16:08:39 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-93135be8-840a-4973-9a41-b4789df464ac tempest-VolumesActionsTest-468242897 None] Attaching volume 4577f1d1-ffb3-4882-bf4a-674ef67c5444 to instance d0c4c878-74b5-4cb3-ab77-c86ebd695b4a at mountpoint /dev/vdb on host None. Jun 24 16:08:39 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f Jun 24 16:08:39 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-93135be8-840a-4973-9a41-b4789df464ac tempest-VolumesActionsTest-468242897 None] Attach volume completed successfully. Jun 24 16:08:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-93135be8-840a-4973-9a41-b4789df464ac tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444" released by "attach_volume" :: held 0.226s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (9d5d52f0-4459-49bd-84e6-c4dba1eea6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f6c56c-cb66-4b5f-99fb-74a005996a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f6c56c-cb66-4b5f-99fb-74a005996a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746588782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60ebd89-8091-4e7c-8896-139c4de17376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:40Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1cb25e-018d-4b5d-a7f7-7cf90d9f3806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1cb25e-018d-4b5d-a7f7-7cf90d9f3806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89eed3b1-53f3-44e3-8fc3-18d2da27bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89eed3b1-53f3-44e3-8fc3-18d2da27bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60ebd89-8091-4e7c-8896-139c4de17376', 'volume_name': 'volume-f60ebd89-8091-4e7c-8896-139c4de17376', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd66bbe5-b0d1-4b00-a826-ef9113bbcedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd66bbe5-b0d1-4b00-a826-ef9113bbcedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d004f617-4c1a-4738-a923-54c76450bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume f60ebd89-8091-4e7c-8896-139c4de17376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60ebd89-8091-4e7c-8896-139c4de17376', 'volume_size': 1} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:40 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b5c045c6-d2cf-40e5-a42d-755084fb7b0a tempest-VolumesActionsTest-468242897 None] Acquiring lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-detach_volume" by "detach_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2" returned: 0 in 0.908s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] <== create_volume: return (2929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.934s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b5c045c6-d2cf-40e5-a42d-755084fb7b0a tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b5c045c6-d2cf-40e5-a42d-755084fb7b0a tempest-VolumesActionsTest-468242897 None] Detaching volume 4577f1d1-ffb3-4882-bf4a-674ef67c5444 from instance d0c4c878-74b5-4cb3-ab77-c86ebd695b4a. Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.524s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435008797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4603da63-0c1b-40b9-9c2a-bb0c3e0712e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:38Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating volume 4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Flow 'volume_create_manager' (532fb523-4ab9-4195-bc01-02e7eea89c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea00ea7-1266-4b9a-98ed-2c08dd1e292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 1073741824 Jun 24 16:08:40 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f613d082-e157-4e51-8842-1aa7f8f5e724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297305fa-33b7-4151-80e4-c556f75ccfb2', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ad54ab-3d70-4e8c-a212-90807510aa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume volume-297305fa-33b7-4151-80e4-c556f75ccfb2 (297305fa-33b7-4151-80e4-c556f75ccfb2): created successfully Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ad54ab-3d70-4e8c-a212-90807510aa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (b7063029-9e93-4865-94f6-7be25c7aac73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea00ea7-1266-4b9a-98ed-2c08dd1e292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-491885247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03375e5-c785-411e-a285-4457a14d6394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fd9a4d454e455c8711a8f8f3315b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:40Z,use_quota=True,user_id='ad0d23762f32497da1b113c739ffa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50812572-3e11-4bf5-8041-ef5b1f6c82ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50812572-3e11-4bf5-8041-ef5b1f6c82ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0a1d0e-1e25-407a-a2b3-5a320a0f2018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0a1d0e-1e25-407a-a2b3-5a320a0f2018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03375e5-c785-411e-a285-4457a14d6394', 'volume_name': 'volume-d03375e5-c785-411e-a285-4457a14d6394', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3d84c3-9e86-454b-a79f-b1636ea14122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3d84c3-9e86-454b-a79f-b1636ea14122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cae0b-aa47-4549-b833-859bdf07b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Volume d03375e5-c785-411e-a285-4457a14d6394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03375e5-c785-411e-a285-4457a14d6394', 'volume_size': 1} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b7c1a9e4-7c14-4c4e-9bc1-89a169d7a9c4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created volume successfully. Jun 24 16:08:40 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.359s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b5c045c6-d2cf-40e5-a42d-755084fb7b0a tempest-VolumesActionsTest-468242897 None] Detach volume completed successfully. Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b5c045c6-d2cf-40e5-a42d-755084fb7b0a tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-detach_volume" released by "detach_volume" :: held 0.248s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:40 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f" returned: 0 in 1.547s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:40 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f Jun 24 16:08:40 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:41 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 1073741824" returned: 0 in 1.112s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:41 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 Jun 24 16:08:41 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:41 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fd44a132-ae25-4bd1-9489-f5708c61594f" returned: 0 in 0.776s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Lock "cinder-quobyte-fd44a132-ae25-4bd1-9489-f5708c61594f" released by "delete_volume" :: held 2.427s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Created reservations ['d9347d07-5439-4e65-8107-646c04917304', 'a02c33c0-081e-4987-b9fa-1ed0dde5b207', 'ac29e4e8-bcb6-4bd5-acef-f8d835c7d877', '4e67364a-8dfc-40e9-8d3c-0d44d724728a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:41 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:41 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:42 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5" returned: 0 in 0.933s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.833s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378393534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ff4440-0d87-4085-930a-ce806189276b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:38Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating volume 66ff4440-0d87-4085-930a-ce806189276b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:42 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:42 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:42 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b 1073741824 Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.853s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:42 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e14067e-3a42-4b06-bd47-8aebe8052882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1dbe33-194a-4b10-9c88-00022f364c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Deleted volume successfully. Jun 24 16:08:42 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 (4603da63-0c1b-40b9-9c2a-bb0c3e0712e5): created successfully Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1dbe33-194a-4b10-9c88-00022f364c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (583b7325-7d77-4afd-b176-8fa08a84282a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7b7a43d7-c034-4c21-9e1d-fbba36c2cbdb tempest-VolumeDependencyTests-221896923 None] Lock "cinder-fd44a132-ae25-4bd1-9489-f5708c61594f-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:42 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7770dc6e-1c2d-4adf-a35e-5c7a6033ebe4 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created volume successfully. Jun 24 16:08:43 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b 1073741824" returned: 0 in 0.958s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:43 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b Jun 24 16:08:43 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:44 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b" returned: 0 in 0.795s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.147s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47381555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c8c415-e40d-4b1e-8ec3-0074c989c87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:39Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating volume c6c8c415-e40d-4b1e-8ec3-0074c989c87c {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:44 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d84e050-bbd9-463d-bcad-27b4439748cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ff4440-0d87-4085-930a-ce806189276b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b45443-575c-494a-99b6-3b2bce78455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:44 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c 1073741824 Jun 24 16:08:44 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:44 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume volume-66ff4440-0d87-4085-930a-ce806189276b (66ff4440-0d87-4085-930a-ce806189276b): created successfully Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b45443-575c-494a-99b6-3b2bce78455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (30530a7a-5141-46e3-9ca4-0dd53a842c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:44 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ca3784dc-987a-4734-99aa-2477ca513090 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created volume successfully. Jun 24 16:08:45 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c 1073741824" returned: 0 in 0.967s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:45 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c Jun 24 16:08:45 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:46 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c" returned: 0 in 0.694s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.723s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746588782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60ebd89-8091-4e7c-8896-139c4de17376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aacda9ce1f5458e8c284cfab83f5c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:40Z,use_quota=True,user_id='a17905d227c047399a57692db8705faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Creating volume f60ebd89-8091-4e7c-8896-139c4de17376 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:46 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08b38f8-3176-4d04-ad22-ec616257526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd010ea7-7fde-41d4-825b-14a3c36d52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:46 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 1073741824 Jun 24 16:08:46 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:46 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c (c6c8c415-e40d-4b1e-8ec3-0074c989c87c): created successfully Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd010ea7-7fde-41d4-825b-14a3c36d52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (b3d50868-efd0-459e-acfa-9ac77f01393b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a11c2f64-7e5a-4c4b-98d1-a776e626f921 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created volume successfully. Jun 24 16:08:47 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 1073741824" returned: 0 in 0.973s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:47 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 Jun 24 16:08:47 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:47 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376" returned: 0 in 0.687s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.244s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-491885247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03375e5-c785-411e-a285-4457a14d6394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fd9a4d454e455c8711a8f8f3315b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:40Z,use_quota=True,user_id='ad0d23762f32497da1b113c739ffa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Creating volume d03375e5-c785-411e-a285-4457a14d6394 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:08:47 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d004f617-4c1a-4738-a923-54c76450bef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60ebd89-8091-4e7c-8896-139c4de17376', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:47 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 1073741824 Jun 24 16:08:47 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f10851-82e7-4631-baf5-50dd5177b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:47 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Volume volume-f60ebd89-8091-4e7c-8896-139c4de17376 (f60ebd89-8091-4e7c-8896-139c4de17376): created successfully Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f10851-82e7-4631-baf5-50dd5177b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Flow 'volume_create_manager' (9d5d52f0-4459-49bd-84e6-c4dba1eea6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2ddb5b70-f410-4575-8161-05a1bb992548 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created volume successfully. Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-f60ebd89-8091-4e7c-8896-139c4de17376-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-f60ebd89-8091-4e7c-8896-139c4de17376-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-f60ebd89-8091-4e7c-8896-139c4de17376" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-f60ebd89-8091-4e7c-8896-139c4de17376" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e77b2-a374-426f-80c2-3ab310d4b2ba]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:48 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 1073741824" returned: 0 in 1.129s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:49 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 Jun 24 16:08:49 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:49 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 Jun 24 16:08:49 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:49 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394" returned: 0 in 0.756s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:49 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376" returned: 0 in 0.926s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cae0b-aa47-4549-b833-859bdf07b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03375e5-c785-411e-a285-4457a14d6394', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c58a7a8-e540-4d8f-b025-6f7ce5661926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:49 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376 Jun 24 16:08:49 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:49 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Volume volume-d03375e5-c785-411e-a285-4457a14d6394 (d03375e5-c785-411e-a285-4457a14d6394): created successfully Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c58a7a8-e540-4d8f-b025-6f7ce5661926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Flow 'volume_create_manager' (532fb523-4ab9-4195-bc01-02e7eea89c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-64c36204-043c-4947-8e61-adf00db95402 tempest-VolumesListAdminTestJSON-381104546 None] Created volume successfully. Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb8010-6738-4f17-86b2-42a3bf2540a4]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:50 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:08:50 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:50 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f60ebd89-8091-4e7c-8896-139c4de17376" returned: 0 in 0.904s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-f60ebd89-8091-4e7c-8896-139c4de17376" released by "delete_volume" :: held 1.893s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['f1412331-f8ec-4384-8b0e-5abc7832144d', '78a6cdfe-b306-4498-beea-539aeec73b69', '0a39f6dd-9177-4af2-a932-a6bbb21ecce0', 'f7cd0e7e-a611-405b-bfe5-2b89d8c2825e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:51 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:51 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-c6c8c415-e40d-4b1e-8ec3-0074c989c87c-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-c6c8c415-e40d-4b1e-8ec3-0074c989c87c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-c6c8c415-e40d-4b1e-8ec3-0074c989c87c" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-c6c8c415-e40d-4b1e-8ec3-0074c989c87c" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed806ceb-74e8-4cce-92b2-8a2bbf52fdfa]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:51 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:08:51 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Flow 'volume_create_manager' (f53e8227-eeb0-49e6-a1ce-d51510124366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d507f0d7-8e53-46d8-94aa-88aa2bedde2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d507f0d7-8e53-46d8-94aa-88aa2bedde2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-490189468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b715c85d-5e32-4fda-bd29-e12bf906a572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fd9a4d454e455c8711a8f8f3315b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:51Z,use_quota=True,user_id='ad0d23762f32497da1b113c739ffa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda017fb-d156-4abb-a1d3-1c86ddaa7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda017fb-d156-4abb-a1d3-1c86ddaa7c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41537ddf-8437-426a-af3a-67d1f8ac1d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41537ddf-8437-426a-af3a-67d1f8ac1d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b715c85d-5e32-4fda-bd29-e12bf906a572', 'volume_name': 'volume-b715c85d-5e32-4fda-bd29-e12bf906a572', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:51 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ea5493-4c3e-4818-ab19-5c6b6e497a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ea5493-4c3e-4818-ab19-5c6b6e497a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33e43a0-abf8-4343-89ed-ac6030d14ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:08:51 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Volume b715c85d-5e32-4fda-bd29-e12bf906a572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b715c85d-5e32-4fda-bd29-e12bf906a572', 'volume_size': 1} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 1.287s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[71087acd-fc0a-4299-98b5-9544d891b9eb]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:51 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:08:51 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:52 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.040s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleted volume successfully. Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a75c983b-3c52-4449-9acb-2e82c4c99c56 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-f60ebd89-8091-4e7c-8896-139c4de17376-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:52 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c" returned: 0 in 1.030s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:52 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c Jun 24 16:08:52 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:52 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.990s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.83e8bf02-a27b-444f-a536-92ccdf70174br8lwu5kf.img {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:52 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.83e8bf02-a27b-444f-a536-92ccdf70174br8lwu5kf.img Jun 24 16:08:52 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:52 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6c8c415-e40d-4b1e-8ec3-0074c989c87c" returned: 0 in 0.695s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-c6c8c415-e40d-4b1e-8ec3-0074c989c87c" released by "delete_volume" :: held 1.804s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['35115263-82c2-4515-8dee-64e90858ce34', 'a296ef5d-30e3-431a-b410-348f164ce57d', '8aaa7387-455b-40f7-beca-34d041127383', 'f10e971a-2e4a-40f4-9a2e-7881fb5a56fc'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:53 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:53 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-66ff4440-0d87-4085-930a-ce806189276b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-66ff4440-0d87-4085-930a-ce806189276b-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-66ff4440-0d87-4085-930a-ce806189276b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-66ff4440-0d87-4085-930a-ce806189276b" acquired by "delete_volume" :: waited 0.038s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b25df-526a-47f0-bb45-be7f82a1db6c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:54 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b Jun 24 16:08:54 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:55 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.857s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:55 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleted volume successfully. Jun 24 16:08:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-40421a4d-0bc4-4227-b49d-c535d02b7df2 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-c6c8c415-e40d-4b1e-8ec3-0074c989c87c-delete_volume" released by "delete_volume" :: held 4.006s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:56 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b" returned: 0 in 2.437s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:56 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b Jun 24 16:08:56 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:58 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66ff4440-0d87-4085-930a-ce806189276b" returned: 0 in 1.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-66ff4440-0d87-4085-930a-ce806189276b" released by "delete_volume" :: held 4.369s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['4de46abe-6edf-43d9-8566-2765a48f0a78', 'ad750772-22c0-4449-83cf-1765de000536', '140bc446-5610-4f50-b6c7-9b14f3dec855', '7b8d37f2-cdc7-4c63-839a-ee71532e3a52'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:58 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:08:58 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:58 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.83e8bf02-a27b-444f-a536-92ccdf70174br8lwu5kf.img" returned: 0 in 6.057s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb746c6-056b-4cc6-92ab-a999cd1395c5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:58 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:08:58 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:59 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.722s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:08:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleted volume successfully. Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=107,cinder:INSERT=36,cinder:UPDATE=121,cinder:DELETE=14 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-711ec747-7e07-4a70-a5f3-4b55a1fe99bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-66ff4440-0d87-4085-930a-ce806189276b-delete_volume" released by "delete_volume" :: held 5.591s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=127,cinder:SELECT=90,cinder:INSERT=24,cinder:DELETE=8 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5" acquired by "delete_volume" :: waited 0.040s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d296b-43ee-4ee0-bdd1-beefb5576ed9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:08:59 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 Jun 24 16:08:59 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:08:59 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 1.326s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.83e8bf02-a27b-444f-a536-92ccdf70174br8lwu5kf.img {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:08:59 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Converted 1024.00 MB image at 169.04 MB/s Jun 24 16:08:59 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] 83e8bf02-a27b-444f-a536-92ccdf70174b was raw, no need to convert to raw {{(pid=93867) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 24 16:09:00 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5" returned: 0 in 0.908s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:00 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5 Jun 24 16:09:00 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5" returned: 0 in 0.763s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:01 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5" released by "delete_volume" :: held 1.736s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['4faa8051-26c3-4e5e-b7cc-46711bc74c6a', 'acdd756d-efe8-4a1f-b43f-cec4fd363478', 'f435fb5a-44c7-4c7e-9868-a22704f9052c', '9a8d12e4-b780-4202-ada9-e75a3d8a251b'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:01 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:01 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-297305fa-33b7-4151-80e4-c556f75ccfb2-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-297305fa-33b7-4151-80e4-c556f75ccfb2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-297305fa-33b7-4151-80e4-c556f75ccfb2" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-297305fa-33b7-4151-80e4-c556f75ccfb2" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1164e218-71b0-4ce7-a815-74dfa1dc85e0]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:02 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 Jun 24 16:09:02 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:02 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.051s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleted volume successfully. Jun 24 16:09:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1c351ea4-6d95-42ad-9340-3ef1b22668ab tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-4603da63-0c1b-40b9-9c2a-bb0c3e0712e5-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:03 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2" returned: 0 in 0.923s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:03 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2 Jun 24 16:09:03 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:03 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-297305fa-33b7-4151-80e4-c556f75ccfb2" returned: 0 in 0.776s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-297305fa-33b7-4151-80e4-c556f75ccfb2" released by "delete_volume" :: held 1.800s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['6a08d70a-7fc1-47f8-8506-e4096fb529f7', '526bb9d7-174d-49f9-8171-54a5234ee93d', '5242ea8f-96bb-44a7-becb-54e3a3e9caca', 'ec18b78d-2adf-4728-91d7-323c63eab408'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:04 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:04 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-c0a34816-e1f9-4152-9f2f-15d3daf28480-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-c0a34816-e1f9-4152-9f2f-15d3daf28480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-4563ca6d-8ed1-476c-9a81-b936ff76e177" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-4563ca6d-8ed1-476c-9a81-b936ff76e177" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-c0a34816-e1f9-4152-9f2f-15d3daf28480" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-c0a34816-e1f9-4152-9f2f-15d3daf28480" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleting offline snapshot c0a34816-e1f9-4152-9f2f-15d3daf28480 of volume 4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] snapshot_file for this snap is: volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac8d12b-f56e-452a-85a1-904505b6be15]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:04 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 Jun 24 16:09:04 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:05 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.896s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleted volume successfully. Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c20a6d29-ff81-4eab-be70-2c83d28335bc tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-297305fa-33b7-4151-80e4-c556f75ccfb2-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:05 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480" returned: 0 in 1.029s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4563ca6d-8ed1-476c-9a81-b936ff76e177(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a33dc-7bc7-48c8-bc59-f1b1dae76cc9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:05 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 Jun 24 16:09:05 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:06 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177" returned: 0 in 1.064s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:06 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 Jun 24 16:09:06 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:08 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480" returned: 0 in 1.352s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:08 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480 Jun 24 16:09:08 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:09 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177.c0a34816-e1f9-4152-9f2f-15d3daf28480" returned: 0 in 1.067s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-c0a34816-e1f9-4152-9f2f-15d3daf28480" released by "_delete_snapshot" :: held 4.704s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-4563ca6d-8ed1-476c-9a81-b936ff76e177" released by "delete_snapshot" :: held 4.755s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['36dd8459-6d4b-4388-9b1e-6c001b548e3c', 'e3644289-6d8f-400b-b4b3-e7e4863880b9', '1f5b21ba-0569-485b-9d5d-46103696762b', 'aad0908a-93fb-46b5-90e7-c92264f24350'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Delete snapshot completed successfully. Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad83104b-80ae-4699-b87b-7838822b0c3b tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-c0a34816-e1f9-4152-9f2f-15d3daf28480-delete_snapshot" released by "delete_snapshot" :: held 4.987s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-4563ca6d-8ed1-476c-9a81-b936ff76e177-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-4563ca6d-8ed1-476c-9a81-b936ff76e177-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "cinder-quobyte-4563ca6d-8ed1-476c-9a81-b936ff76e177" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-4563ca6d-8ed1-476c-9a81-b936ff76e177" acquired by "delete_volume" :: waited 0.043s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e74fc2-1509-4b54-a1a4-fe88b69dfa0d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:10 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 Jun 24 16:09:10 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:11 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177" returned: 0 in 1.009s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:11 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177 Jun 24 16:09:11 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:11 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4563ca6d-8ed1-476c-9a81-b936ff76e177" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-quobyte-4563ca6d-8ed1-476c-9a81-b936ff76e177" released by "delete_volume" :: held 1.889s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Created reservations ['99bd6425-4626-4d9a-b211-7c3fccf4e8d5', '38d6fa17-e544-4b3e-b30b-66f40d1b11da', '402192ac-bbee-41bc-b81a-e2584e3962c8', '3c9ebd94-08f1-45c5-80fc-39d2f480b4a5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Flow 'volume_create_manager' (bcc0cd5e-962e-4ccb-9519-14f7cdd89dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e310a3-3388-4468-9cce-7278ee3b86dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e310a3-3388-4468-9cce-7278ee3b86dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2047250528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1789f1db-434b-45df-a476-8400c0310e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669c6c91f2154c90b29b6b91339e7722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:12Z,use_quota=True,user_id='188c5feeec7d4253805c13a519cc02ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2f2223-c45c-473b-9642-b84f19564a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2f2223-c45c-473b-9642-b84f19564a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4acfc5-47af-4686-b116-f65e2263de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4acfc5-47af-4686-b116-f65e2263de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1789f1db-434b-45df-a476-8400c0310e56', 'volume_name': 'volume-1789f1db-434b-45df-a476-8400c0310e56', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a331d4-f87f-42f9-92c8-8d8956edc017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a331d4-f87f-42f9-92c8-8d8956edc017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0da091-7561-4332-b6c0-fbb2783d1ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Volume 1789f1db-434b-45df-a476-8400c0310e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1789f1db-434b-45df-a476-8400c0310e56', 'volume_size': 1} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:12 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:12 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:13 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.690s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:13 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Deleted volume successfully. Jun 24 16:09:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e6500fd4-e518-4442-969e-4cb667b87f17 tempest-CreateVolumesFromSnapshotTest-966698414 None] Lock "cinder-4563ca6d-8ed1-476c-9a81-b936ff76e177-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Flow 'volume_create_manager' (c972569d-bc7d-406f-9a80-11e5d3891689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7b30f0-6864-4f4c-8927-bccd39f4a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7b30f0-6864-4f4c-8927-bccd39f4a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751789ef-fdd4-402d-a7f4-dfab94c17074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba583326c3f4182bd53932c8802d257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:19Z,use_quota=True,user_id='7fb58aa725214aee86a04202510a4496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957cc912-36b4-4898-83b3-debdc5d10c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957cc912-36b4-4898-83b3-debdc5d10c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f450e13-25ca-4192-aeee-a51b23895de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f450e13-25ca-4192-aeee-a51b23895de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '751789ef-fdd4-402d-a7f4-dfab94c17074', 'volume_name': 'volume-751789ef-fdd4-402d-a7f4-dfab94c17074', 'volume_size': 1, 'image_id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30c6c018f13b4580950a7091f6246794', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eba583326c3f4182bd53932c8802d257', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb31bfd86c8a6ca1cfc026fb1c07b73ca3cbd932e964e1565b47faee33b42109764b38367a060d50a5025fa8406cb3eb279cbc17f668894985150656bd96d331', 'id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'created_at': datetime.datetime(2026, 6, 24, 14, 9, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 9, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2/file', 'properties': {}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28e3085-913a-4fc7-ab4a-751c01f2293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28e3085-913a-4fc7-ab4a-751c01f2293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5479ece-a8bf-4afb-99d7-ac06597e4f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:19 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Volume 751789ef-fdd4-402d-a7f4-dfab94c17074: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-751789ef-fdd4-402d-a7f4-dfab94c17074', 'volume_size': 1, 'image_id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30c6c018f13b4580950a7091f6246794', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eba583326c3f4182bd53932c8802d257', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb31bfd86c8a6ca1cfc026fb1c07b73ca3cbd932e964e1565b47faee33b42109764b38367a060d50a5025fa8406cb3eb279cbc17f668894985150656bd96d331', 'id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'created_at': datetime.datetime(2026, 6, 24, 14, 9, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 9, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2/file', 'properties': {}}, 'image_service': } Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Trying to clone 751789ef-fdd4-402d-a7f4-dfab94c17074 from image 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:09:19 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Image download 0.00 MB at 0.00 MB/s Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88c430-f0f0-4580-abc9-607ae7dcab1f]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:19 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD Jun 24 16:09:19 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:20 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:20 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD Jun 24 16:09:20 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:21 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD" returned: 1 in 0.732s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Temporary image 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 is fetched for user 7fb58aa725214aee86a04202510a4496. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[456111b8-38b3-4e16-ac09-046e58535a30]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:21 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD Jun 24 16:09:21 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:21 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:22 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD Jun 24 16:09:22 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:22 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD" returned: 1 in 0.799s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.900s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Uploaded volume to glance image-id: 83e8bf02-a27b-444f-a536-92ccdf70174b. {{(pid=93867) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.598s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-490189468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b715c85d-5e32-4fda-bd29-e12bf906a572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fd9a4d454e455c8711a8f8f3315b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:08:51Z,use_quota=True,user_id='ad0d23762f32497da1b113c739ffa94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Creating volume b715c85d-5e32-4fda-bd29-e12bf906a572 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:23 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:09:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:23 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 1073741824 Jun 24 16:09:23 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-80d1ff97-8a93-40e4-bb0d-1a05588d4c7e tempest-VolumesActionsTest-468242897 None] Copy volume to image completed successfully. Jun 24 16:09:24 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 1073741824" returned: 0 in 0.873s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:24 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 Jun 24 16:09:24 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:24 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572" returned: 0 in 0.639s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.908s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2047250528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1789f1db-434b-45df-a476-8400c0310e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669c6c91f2154c90b29b6b91339e7722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:12Z,use_quota=True,user_id='188c5feeec7d4253805c13a519cc02ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Creating volume 1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:24 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33e43a0-abf8-4343-89ed-ac6030d14ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b715c85d-5e32-4fda-bd29-e12bf906a572', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:24 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 1073741824 Jun 24 16:09:24 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f0c936-27ca-47c5-a8c4-9f08da2ed49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:24 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Volume volume-b715c85d-5e32-4fda-bd29-e12bf906a572 (b715c85d-5e32-4fda-bd29-e12bf906a572): created successfully Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f0c936-27ca-47c5-a8c4-9f08da2ed49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:24 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Flow 'volume_create_manager' (f53e8227-eeb0-49e6-a1ce-d51510124366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ac9d4a05-a8c4-499b-bf30-af442c156145 tempest-VolumesListAdminTestJSON-381104546 None] Created volume successfully. Jun 24 16:09:25 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 1073741824" returned: 0 in 0.821s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:25 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:09:25 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:26 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.652s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751789ef-fdd4-402d-a7f4-dfab94c17074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba583326c3f4182bd53932c8802d257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:19Z,use_quota=True,user_id='7fb58aa725214aee86a04202510a4496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Creating volume 751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:26 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0da091-7561-4332-b6c0-fbb2783d1ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1789f1db-434b-45df-a476-8400c0310e56', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:26 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 1073741824 Jun 24 16:09:26 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421c0694-213d-454e-9c55-92cd65851ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:26 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Volume volume-1789f1db-434b-45df-a476-8400c0310e56 (1789f1db-434b-45df-a476-8400c0310e56): created successfully Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421c0694-213d-454e-9c55-92cd65851ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Flow 'volume_create_manager' (bcc0cd5e-962e-4ccb-9519-14f7cdd89dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:26 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-587c221e-264f-4ea5-b480-286f44ea994f tempest-SnapshotDependencyTests-1280640013 None] Created volume successfully. Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Flow 'volume_create_manager' (1421e2df-2de6-49ad-b915-69649b554f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a060e9be-de9b-43df-9ee0-f058d01efb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a060e9be-de9b-43df-9ee0-f058d01efb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46f7f74-120e-4332-92d9-3746b6fece8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b374af35e934fe4b6a82b39b2adf7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:26Z,use_quota=True,user_id='7fb6383c5b974f27b22524d9b7548819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34785123-6731-4275-b7b7-61b9e9d1fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34785123-6731-4275-b7b7-61b9e9d1fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82560262-4091-44d7-b07c-14e0b445e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82560262-4091-44d7-b07c-14e0b445e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46f7f74-120e-4332-92d9-3746b6fece8b', 'volume_name': 'volume-a46f7f74-120e-4332-92d9-3746b6fece8b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91e87ab-191c-4cf1-b387-0d0ae8b97c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91e87ab-191c-4cf1-b387-0d0ae8b97c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20ada3e-eedf-404b-a5d3-f5fb16bbb239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:26 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Volume a46f7f74-120e-4332-92d9-3746b6fece8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46f7f74-120e-4332-92d9-3746b6fece8b', 'volume_size': 1} Jun 24 16:09:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:27 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 1073741824" returned: 0 in 0.862s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:27 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:27 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:27 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 0 in 0.720s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.580s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e455555-5cff-4002-bcb5-12adf3c74753]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:28 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:09:28 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Attempting download of 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'metadata': {}}])) to volume 751789ef-fdd4-402d-a7f4-dfab94c17074. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce8479-1308-4ccc-be84-e9c2df5ecd6e]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:28 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d Jun 24 16:09:28 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:28 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.841s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7884dc-bd33-4893-a107-6f9032f99ea9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:28 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:09:28 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:28 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d" returned: 0 in 0.754s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:28 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d Jun 24 16:09:28 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:29 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.792s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:29 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img Jun 24 16:09:29 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:29 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d" returned: 1 in 0.794s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_1xtsuy8d' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b58e64-c447-4c0d-b622-08523381eb57]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:29 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD Jun 24 16:09:29 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:30 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:30 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD Jun 24 16:09:30 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:31 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD" returned: 1 in 1.525s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:31 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 was raw, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:09:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:32 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:32 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:33 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 0 in 1.845s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:33 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2_mr4we0mzdevstack@QuobyteHD, size 0.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:09:33 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 16:09:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:33 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 1G Jun 24 16:09:33 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:34 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img" returned: 0 in 4.976s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:34 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed137ff-9f4f-44b4-8e5e-4d3f512b9b57]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:34 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:09:34 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:34 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 1G" returned: 0 in 1.004s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:34 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262644f-bf6b-41cb-8b84-6cf3e1cc532d]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:35 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:35 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:35 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.933s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:09:35 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Converted 1024.00 MB image at 205.73 MB/s Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] 19ca5e1c-bd8e-4177-88d1-b99ca8857194 was raw, converting to qcow2 {{(pid=93867) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fdd540-f4a7-4623-9271-e9fb03b470fa]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:35 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img Jun 24 16:09:35 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:35 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 0 in 0.762s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:35 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:35 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:36 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img" returned: 0 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:36 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img Jun 24 16:09:36 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:36 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 1 in 0.724s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Downloaded image 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'metadata': {}}])) to volume 751789ef-fdd4-402d-a7f4-dfab94c17074 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Temporary image 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 for user 7fb58aa725214aee86a04202510a4496 is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Marking volume 751789ef-fdd4-402d-a7f4-dfab94c17074 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Copying metadata from image 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 to 751789ef-fdd4-402d-a7f4-dfab94c17074. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Creating volume glance metadata for volume 751789ef-fdd4-402d-a7f4-dfab94c17074 backed by image 63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2 with: {'image_id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '30c6c018f13b4580950a7091f6246794', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5479ece-a8bf-4afb-99d7-ac06597e4f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751789ef-fdd4-402d-a7f4-dfab94c17074', 'volume_size': 1, 'image_id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30c6c018f13b4580950a7091f6246794', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eba583326c3f4182bd53932c8802d257', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb31bfd86c8a6ca1cfc026fb1c07b73ca3cbd932e964e1565b47faee33b42109764b38367a060d50a5025fa8406cb3eb279cbc17f668894985150656bd96d331', 'id': '63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2', 'created_at': datetime.datetime(2026, 6, 24, 14, 9, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 9, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63f47d5e-ae2b-4e9e-8e54-19d8a8ca71e2/file', 'properties': {}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9b45f6-a4a9-4175-bc83-3fe33b710d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:36 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Volume volume-751789ef-fdd4-402d-a7f4-dfab94c17074 (751789ef-fdd4-402d-a7f4-dfab94c17074): created successfully Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9b45f6-a4a9-4175-bc83-3fe33b710d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Flow 'volume_create_manager' (c972569d-bc7d-406f-9a80-11e5d3891689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-115bd298-e0c1-416a-892a-f9c2439c8212 tempest-VolumeImageDependencyTests-1606642901 None] Created volume successfully. Jun 24 16:09:36 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img" returned: 1 in 0.734s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:37 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i Jun 24 16:09:37 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:37 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i" returned: 0 in 0.635s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Image conversion details: src /opt/stack/data/cinder/conversion/4577f1d1-ffb3-4882-bf4a-674ef67c5444.temp_image.19ca5e1c-bd8e-4177-88d1-b99ca885719433cljr2k.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:09:37 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[889007bf-7cee-4bf0-b592-b204b5709601]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:37 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i Jun 24 16:09:37 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Acquiring lock "cinder-751789ef-fdd4-402d-a7f4-dfab94c17074-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Lock "cinder-751789ef-fdd4-402d-a7f4-dfab94c17074-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Acquiring lock "cinder-quobyte-751789ef-fdd4-402d-a7f4-dfab94c17074" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Lock "cinder-quobyte-751789ef-fdd4-402d-a7f4-dfab94c17074" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd3466-b0d2-44a1-9437-0eab5ff5232f]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:37 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:37 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:38 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o_tjln2i" returned: 0 in 0.736s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:38 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 0 in 0.775s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:38 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:38 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:39 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:39 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:39 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 1 in 0.748s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:39 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074 Jun 24 16:09:39 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.841s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Uploaded volume to glance image-id: 19ca5e1c-bd8e-4177-88d1-b99ca8857194. {{(pid=93867) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.231s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46f7f74-120e-4332-92d9-3746b6fece8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b374af35e934fe4b6a82b39b2adf7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:26Z,use_quota=True,user_id='7fb6383c5b974f27b22524d9b7548819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Creating volume a46f7f74-120e-4332-92d9-3746b6fece8b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:39 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b 1073741824 Jun 24 16:09:39 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c8d16d65-2b15-409c-8ae0-f90c2e9dbf35 tempest-VolumesActionsTest-468242897 None] Copy volume to image completed successfully. Jun 24 16:09:39 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.726s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:09:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:09:40 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-751789ef-fdd4-402d-a7f4-dfab94c17074" returned: 0 in 0.683s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Lock "cinder-quobyte-751789ef-fdd4-402d-a7f4-dfab94c17074" released by "delete_volume" :: held 2.282s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Created reservations ['b43cbbce-df22-40a9-b026-06163bac1ea6', 'cb41f4a2-039a-412a-b457-8831f76940e2', '14de290e-6ddd-42ef-b4b2-b4ee9fd3f326', 'd2ce44a7-b7ea-40ad-8f19-3e1f4a00b3f2'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:40 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:40 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:40 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Acquiring lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b 1073741824" returned: 0 in 0.924s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Acquiring lock "cinder-quobyte-4577f1d1-ffb3-4882-bf4a-674ef67c5444" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:40 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b Jun 24 16:09:40 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Lock "cinder-quobyte-4577f1d1-ffb3-4882-bf4a-674ef67c5444" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4bfdd0-4a7c-4bd3-b2ca-1120a60350ba]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:40 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:09:40 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:40 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.750s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Deleted volume successfully. Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-8e41f256-ff01-4d39-a93c-cc6740f9cb3d tempest-VolumeImageDependencyTests-1606642901 None] Lock "cinder-751789ef-fdd4-402d-a7f4-dfab94c17074-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:41 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b" returned: 0 in 0.751s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.419s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20ada3e-eedf-404b-a5d3-f5fb16bbb239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46f7f74-120e-4332-92d9-3746b6fece8b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6516cb8d-327c-40dd-bf33-cf6a1fa5f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Creating offline snapshot 1b811379-46f3-4cda-b917-decfc8c62966 of volume 1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:09:41 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Volume volume-a46f7f74-120e-4332-92d9-3746b6fece8b (a46f7f74-120e-4332-92d9-3746b6fece8b): created successfully Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6516cb8d-327c-40dd-bf33-cf6a1fa5f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Flow 'volume_create_manager' (1421e2df-2de6-49ad-b915-69649b554f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fd8af8-7b7a-4a19-a152-7ff2b6a5c762]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b4b25aea-3854-4385-8b38-d1cbd9b4bdfd tempest-VolumesListAdminTestJSON-2132238686 None] Created volume successfully. Jun 24 16:09:41 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:41 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.863s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:41 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:41 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444 Jun 24 16:09:41 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:42 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4577f1d1-ffb3-4882-bf4a-674ef67c5444" returned: 0 in 0.714s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Lock "cinder-quobyte-4577f1d1-ffb3-4882-bf4a-674ef67c5444" released by "delete_volume" :: held 1.625s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:42 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.892s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Created reservations ['82876e55-2b3d-4f11-be64-05e523b4f5e2', 'f00f2d55-7ad4-4f66-8d0c-cda414c202d6', 'af04e724-eaa4-423a-b8b9-ac6157b5833e', '65d58500-1cc1-4761-8057-90fa85ee92bb'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:42 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 1G Jun 24 16:09:42 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:42 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:42 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Acquiring lock "cinder-a46f7f74-120e-4332-92d9-3746b6fece8b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Lock "cinder-a46f7f74-120e-4332-92d9-3746b6fece8b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Acquiring lock "cinder-quobyte-a46f7f74-120e-4332-92d9-3746b6fece8b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Lock "cinder-quobyte-a46f7f74-120e-4332-92d9-3746b6fece8b" acquired by "delete_volume" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "cinder-b715c85d-5e32-4fda-bd29-e12bf906a572-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-b715c85d-5e32-4fda-bd29-e12bf906a572-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae61ba9-e5a0-40cb-b6e1-72a2d3693c42]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "cinder-quobyte-b715c85d-5e32-4fda-bd29-e12bf906a572" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-quobyte-b715c85d-5e32-4fda-bd29-e12bf906a572" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[539519cd-025b-4d81-b7da-edae4ca8de4d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:43 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b Jun 24 16:09:43 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:43 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 Jun 24 16:09:43 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:43 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.097s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Deleted volume successfully. Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c6c83e18-3a2f-44bc-9f8e-302a46f539ab tempest-VolumesActionsTest-468242897 None] Lock "cinder-4577f1d1-ffb3-4882-bf4a-674ef67c5444-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:43 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 1G" returned: 0 in 1.338s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1789f1db-434b-45df-a476-8400c0310e56 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:43 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1789f1db-434b-45df-a476-8400c0310e56 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 Jun 24 16:09:43 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:44 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b" returned: 0 in 1.191s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:44 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b Jun 24 16:09:44 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:44 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572" returned: 0 in 1.201s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:44 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572 Jun 24 16:09:44 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:44 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1789f1db-434b-45df-a476-8400c0310e56 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966" returned: 0 in 0.916s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:44 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 is being set with open permissions: ugo+rw Jun 24 16:09:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:44 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 Jun 24 16:09:44 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:45 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-a46f7f74-120e-4332-92d9-3746b6fece8b" returned: 0 in 0.843s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Lock "cinder-quobyte-a46f7f74-120e-4332-92d9-3746b6fece8b" released by "delete_volume" :: held 2.146s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Created reservations ['7bcae9e5-6717-4499-8183-9243bb50bcec', '0b9e4917-315a-454f-bb30-e99721743e37', '2f37e384-9f16-44f9-ad68-c166dfb521a0', '8651c1d0-75bd-414d-974a-1f125998255c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:45 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b715c85d-5e32-4fda-bd29-e12bf906a572" returned: 0 in 0.952s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:45 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-quobyte-b715c85d-5e32-4fda-bd29-e12bf906a572" released by "delete_volume" :: held 2.266s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:45 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:45 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966" returned: 0 in 0.847s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Created reservations ['58a8f7ba-2383-4fd6-887c-b7482e5c5622', '130c8838-dae3-4d61-9ddb-0c7378a82fab', '0948aafa-bf7d-4f9a-8001-c4563d6f15ce', '8175c010-bd77-42db-a2e6-eae6b8fb3495'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:45 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info Jun 24 16:09:45 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Flow 'volume_create_manager' (4f096e15-31f1-4a27-8ac7-b572ae025f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbc98ce-c369-416f-88f7-7edffe563c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcbc98ce-c369-416f-88f7-7edffe563c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070c1f6d-6db8-4580-8ed9-066199119f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ead8dabd3544288b61be6ce88c79dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:46Z,use_quota=True,user_id='daf8ce5273c14b84982cd3c9c6777027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec157cf-511f-4c7a-aff1-22dd3cae6f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec157cf-511f-4c7a-aff1-22dd3cae6f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93abcc98-9bf9-494c-9f70-539e0e82c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93abcc98-9bf9-494c-9f70-539e0e82c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070c1f6d-6db8-4580-8ed9-066199119f2f', 'volume_name': 'volume-070c1f6d-6db8-4580-8ed9-066199119f2f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2955fe-ebe5-4d1b-86c8-6b133f94bdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2955fe-ebe5-4d1b-86c8-6b133f94bdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d57ffe4-2227-4a2a-8895-3749df739f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:45 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Volume 070c1f6d-6db8-4580-8ed9-066199119f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070c1f6d-6db8-4580-8ed9-066199119f2f', 'volume_size': 1} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:45 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:45 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:46 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.829s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Deleted volume successfully. Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c3ba6775-1e89-41e1-9888-4182385fc37f tempest-VolumesListAdminTestJSON-2132238686 None] Lock "cinder-a46f7f74-120e-4332-92d9-3746b6fece8b-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:46 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info" returned: 0 in 0.747s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:46 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info is being set with open permissions: ugo+rw Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:46 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info Jun 24 16:09:46 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "cinder-d03375e5-c785-411e-a285-4457a14d6394-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:46 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.913s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Deleted volume successfully. Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-d03375e5-c785-411e-a285-4457a14d6394-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ad394e50-00d7-43a5-9c9f-d4687754842b tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-b715c85d-5e32-4fda-bd29-e12bf906a572-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "cinder-quobyte-d03375e5-c785-411e-a285-4457a14d6394" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-quobyte-d03375e5-c785-411e-a285-4457a14d6394" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a05e5a-69e6-4e37-ba8e-e5bd3238ba7f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:46 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 Jun 24 16:09:46 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:47 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.info" returned: 0 in 0.751s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.657s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070c1f6d-6db8-4580-8ed9-066199119f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ead8dabd3544288b61be6ce88c79dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:46Z,use_quota=True,user_id='daf8ce5273c14b84982cd3c9c6777027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Creating volume 070c1f6d-6db8-4580-8ed9-066199119f2f {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:47 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:47 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f 1073741824 Jun 24 16:09:47 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ebaa51e9-46a4-4c71-8476-68bf88aa5247 tempest-SnapshotDependencyTests-1280640013 None] Create snapshot completed successfully Jun 24 16:09:47 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394" returned: 0 in 0.965s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:47 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394 Jun 24 16:09:47 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:48 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f 1073741824" returned: 0 in 1.043s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:48 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f Jun 24 16:09:48 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Flow 'volume_create_manager' (68abbfc2-5e87-473c-b9b4-e8dd167cc83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d19e9e6-bdf8-4da8-a056-e9979e44678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d19e9e6-bdf8-4da8-a056-e9979e44678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27f49e8-7a0f-4443-bcc8-a861181b6d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669c6c91f2154c90b29b6b91339e7722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b811379-46f3-4cda-b917-decfc8c62966,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:48Z,use_quota=True,user_id='188c5feeec7d4253805c13a519cc02ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec88816-c447-4f75-9a95-41468499879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec88816-c447-4f75-9a95-41468499879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb03a105-1eda-46a0-a33b-c94bac5d7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb03a105-1eda-46a0-a33b-c94bac5d7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd27f49e8-7a0f-4443-bcc8-a861181b6d51', 'volume_name': 'volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51', 'volume_size': 1, 'snapshot_id': '1b811379-46f3-4cda-b917-decfc8c62966'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca16d20-38b7-4d4b-973a-384c10918941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca16d20-38b7-4d4b-973a-384c10918941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4765f267-3f9f-4b09-a9eb-d4d6f37127f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Volume d27f49e8-7a0f-4443-bcc8-a861181b6d51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51', 'volume_size': 1, 'snapshot_id': '1b811379-46f3-4cda-b917-decfc8c62966'} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:48 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d03375e5-c785-411e-a285-4457a14d6394" returned: 0 in 0.814s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-quobyte-d03375e5-c785-411e-a285-4457a14d6394" released by "delete_volume" :: held 1.828s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Created reservations ['4ecd7a76-d9e9-4974-b8aa-32b161a8dab2', '89790a8d-e589-4be9-9759-a895a4673f55', '4514c3ae-85e6-41fe-abe1-e5908f65c337', '36f7be11-b6bc-423f-84da-d8aa540f6d02'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:48 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:48 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:49 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f" returned: 0 in 0.819s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.541s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-quobyte-1b811379-46f3-4cda-b917-decfc8c62966-d27f49e8-7a0f-4443-bcc8-a861181b6d51" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d57ffe4-2227-4a2a-8895-3749df739f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070c1f6d-6db8-4580-8ed9-066199119f2f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33c71d7-0071-4275-af14-15af3e1f339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1b811379-46f3-4cda-b917-decfc8c62966-d27f49e8-7a0f-4443-bcc8-a861181b6d51" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Creating volume d27f49e8-7a0f-4443-bcc8-a861181b6d51 from snapshot 1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-quobyte-d27f49e8-7a0f-4443-bcc8-a861181b6d51" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "cinder-475bab9e-44f5-4c84-9bba-1672bbd71116-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-d27f49e8-7a0f-4443-bcc8-a861181b6d51" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] snapshot: 1b811379-46f3-4cda-b917-decfc8c62966, volume: d27f49e8-7a0f-4443-bcc8-a861181b6d51, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:09:49 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Volume volume-070c1f6d-6db8-4580-8ed9-066199119f2f (070c1f6d-6db8-4580-8ed9-066199119f2f): created successfully Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33c71d7-0071-4275-af14-15af3e1f339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Flow 'volume_create_manager' (4f096e15-31f1-4a27-8ac7-b572ae025f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-475bab9e-44f5-4c84-9bba-1672bbd71116-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1b989530-b3c6-4916-9299-2ced0bcf09dd tempest-CinderUnicodeTest-1565901086 None] Created volume successfully. Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17e67f-cc95-4972-87d6-ba15d679084d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "cinder-quobyte-475bab9e-44f5-4c84-9bba-1672bbd71116" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-quobyte-475bab9e-44f5-4c84-9bba-1672bbd71116" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a89ec4-2cb7-414e-b81e-ecd36e09c479]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:49 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 Jun 24 16:09:49 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:49 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 Jun 24 16:09:49 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:49 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.834s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Deleted volume successfully. Jun 24 16:09:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dee7f239-ece3-458b-ad20-fd7ca1884784 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-d03375e5-c785-411e-a285-4457a14d6394-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:50 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966" returned: 0 in 0.938s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1789f1db-434b-45df-a476-8400c0310e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8929a8-b496-44d0-a304-822037d1d658]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:50 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116" returned: 0 in 0.940s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:50 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116 Jun 24 16:09:50 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:50 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:09:50 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Flow 'volume_create_manager' (2433911e-4d88-41a1-afcb-a523c8685c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9897930-6b52-4718-9dbf-d7cf3d251c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9897930-6b52-4718-9dbf-d7cf3d251c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2032657646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9e0daf-0c16-4cb5-9a28-76bca4b1f336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ead8dabd3544288b61be6ce88c79dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:51Z,use_quota=True,user_id='daf8ce5273c14b84982cd3c9c6777027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fcdc01-f952-4984-bad5-06b44e7d0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fcdc01-f952-4984-bad5-06b44e7d0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a57e492-15db-449b-8ca7-7634ca51e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a57e492-15db-449b-8ca7-7634ca51e79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9e0daf-0c16-4cb5-9a28-76bca4b1f336', 'volume_name': 'volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696123a0-c99d-461e-8d83-5a27520d3374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696123a0-c99d-461e-8d83-5a27520d3374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af609946-a100-404f-a02e-68e8a5a25921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:50 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Volume 6e9e0daf-0c16-4cb5-9a28-76bca4b1f336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336', 'volume_size': 1} Jun 24 16:09:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:51 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-475bab9e-44f5-4c84-9bba-1672bbd71116" returned: 0 in 0.844s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-quobyte-475bab9e-44f5-4c84-9bba-1672bbd71116" released by "delete_volume" :: held 1.847s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:51 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.984s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:51 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 Jun 24 16:09:51 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Created reservations ['a573f954-3de2-48ee-966b-1f1b6c904ba8', '17651dcd-42be-4cf1-a458-d52de778c7b9', 'e8773e6c-e312-488c-8766-82f00810aa38', 'b9b038f4-0bbf-4166-8eda-e42f7d9cec80'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:51 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:09:51 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Flow 'volume_create_manager' (36cdf854-fa03-40cb-994b-b07b85a6ff42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1213b136-1aa0-44f6-8342-786e2ee09d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1213b136-1aa0-44f6-8342-786e2ee09d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-350492870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f0b19e-ab23-4d9e-899f-65da133ac15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff7440cc7bc455cb7d4e16c1d106660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:52Z,use_quota=True,user_id='87f08eb36da2459680f767076c1b6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e8e34a-277b-437c-85ce-905ea6972d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e8e34a-277b-437c-85ce-905ea6972d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e89645a-1e37-428e-9893-ac9441ccd5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e89645a-1e37-428e-9893-ac9441ccd5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f0b19e-ab23-4d9e-899f-65da133ac15b', 'volume_name': 'volume-05f0b19e-ab23-4d9e-899f-65da133ac15b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f01480e-45ef-4e45-8240-0be41ec34743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f01480e-45ef-4e45-8240-0be41ec34743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8a3b29-4795-4670-b923-aa3537e99c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:52 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Volume 05f0b19e-ab23-4d9e-899f-65da133ac15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f0b19e-ab23-4d9e-899f-65da133ac15b', 'volume_size': 1} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:52 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.908s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:09:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Deleted volume successfully. Jun 24 16:09:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ffb74a34-f7d3-4c04-af6c-198f8fb79349 tempest-VolumesListAdminTestJSON-381104546 None] Lock "cinder-475bab9e-44f5-4c84-9bba-1672bbd71116-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:57 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51" returned: 0 in 5.799s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:57 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9738009-81c1-4bb2-a95f-9fde363f305e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:57 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:09:57 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:57 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.925s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:57 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:09:57 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Converted 1024.00 MB image at 176.55 MB/s Jun 24 16:09:57 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 is being set with open permissions: ugo+rw Jun 24 16:09:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:57 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 Jun 24 16:09:57 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:58 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-d27f49e8-7a0f-4443-bcc8-a861181b6d51" released by "_copy_volume_from_snapshot" :: held 9.464s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1b811379-46f3-4cda-b917-decfc8c62966-d27f49e8-7a0f-4443-bcc8-a861181b6d51" released by "_create_volume_from_snapshot" :: held 9.532s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.580s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.837s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2032657646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9e0daf-0c16-4cb5-9a28-76bca4b1f336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ead8dabd3544288b61be6ce88c79dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:51Z,use_quota=True,user_id='daf8ce5273c14b84982cd3c9c6777027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Creating volume 6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:09:58 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:58 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 1073741824 Jun 24 16:09:58 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4765f267-3f9f-4b09-a9eb-d4d6f37127f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51', 'volume_size': 1, 'snapshot_id': '1b811379-46f3-4cda-b917-decfc8c62966'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4be48-6f6e-4bd1-82ca-1882c28e978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:58 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Volume volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 (d27f49e8-7a0f-4443-bcc8-a861181b6d51): created successfully Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea4be48-6f6e-4bd1-82ca-1882c28e978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Flow 'volume_create_manager' (68abbfc2-5e87-473c-b9b4-e8dd167cc83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:58 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-66f695e8-30a5-44f0-8c1b-1b0a5037837a tempest-SnapshotDependencyTests-1280640013 None] Created volume successfully. Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=88,cinder:UPDATE=98,cinder:INSERT=20,cinder:DELETE=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Flow 'volume_create_manager' (fd882221-941c-4484-9fab-30e9a33be4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28749ade-f289-49e9-89ae-c5a1f0df8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28749ade-f289-49e9-89ae-c5a1f0df8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1380487491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb23261-95a2-4d75-a069-29a3d4b68cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c65d985bd64067a16ddecc6149104e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:59Z,use_quota=True,user_id='798a1163ad2c445b8ef736addc554fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b27c9f-9588-4ce9-a442-8518d2760194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b27c9f-9588-4ce9-a442-8518d2760194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411cce0-026b-4313-928f-80986beaa10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411cce0-026b-4313-928f-80986beaa10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb23261-95a2-4d75-a069-29a3d4b68cfd', 'volume_name': 'volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbea1e3-a9bd-4791-aae2-f71081262a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbea1e3-a9bd-4791-aae2-f71081262a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798f73c5-098f-46ca-ad7e-2cd612d4465c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:09:59 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Volume bfb23261-95a2-4d75-a069-29a3d4b68cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd', 'volume_size': 1} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-1b811379-46f3-4cda-b917-decfc8c62966-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-1b811379-46f3-4cda-b917-decfc8c62966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-quobyte-1789f1db-434b-45df-a476-8400c0310e56" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1789f1db-434b-45df-a476-8400c0310e56" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-quobyte-1b811379-46f3-4cda-b917-decfc8c62966" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1b811379-46f3-4cda-b917-decfc8c62966" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Deleting offline snapshot 1b811379-46f3-4cda-b917-decfc8c62966 of volume 1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:09:59 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] snapshot_file for this snap is: volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 1073741824" returned: 0 in 0.959s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b0846f-0744-42bf-955a-e67f2e091ea1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:09:59 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 Jun 24 16:09:59 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:09:59 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 Jun 24 16:09:59 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:00 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" returned: 0 in 0.639s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.262s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-350492870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f0b19e-ab23-4d9e-899f-65da133ac15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff7440cc7bc455cb7d4e16c1d106660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:52Z,use_quota=True,user_id='87f08eb36da2459680f767076c1b6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Creating volume 05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:10:00 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=67,cinder:INSERT=36,cinder:UPDATE=104,cinder:DELETE=11 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af609946-a100-404f-a02e-68e8a5a25921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e92056a-a6ac-43a9-b4c7-466fee9c93f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:00 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b 1073741824 Jun 24 16:10:00 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:00 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Volume volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 (6e9e0daf-0c16-4cb5-9a28-76bca4b1f336): created successfully Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e92056a-a6ac-43a9-b4c7-466fee9c93f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Flow 'volume_create_manager' (2433911e-4d88-41a1-afcb-a523c8685c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:00 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e9792925-0dbe-4346-b130-456b192cf303 tempest-CinderUnicodeTest-1565901086 None] Created volume successfully. Jun 24 16:10:00 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966" returned: 0 in 0.787s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1789f1db-434b-45df-a476-8400c0310e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df4061-51c9-42f5-bd0e-e67fb6031f74]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:00 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:10:00 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:01 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.791s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:01 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b 1073741824" returned: 0 in 0.937s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:01 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 Jun 24 16:10:01 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:01 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:01 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:01 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 0.688s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.455s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1380487491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb23261-95a2-4d75-a069-29a3d4b68cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c65d985bd64067a16ddecc6149104e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:09:59Z,use_quota=True,user_id='798a1163ad2c445b8ef736addc554fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Creating volume bfb23261-95a2-4d75-a069-29a3d4b68cfd {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:10:01 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:10:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8a3b29-4795-4670-b923-aa3537e99c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f0b19e-ab23-4d9e-899f-65da133ac15b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:02 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd 1073741824 Jun 24 16:10:02 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab592f9-6a5f-43d0-8954-ade8743de422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:02 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966" returned: 0 in 0.805s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Volume volume-05f0b19e-ab23-4d9e-899f-65da133ac15b (05f0b19e-ab23-4d9e-899f-65da133ac15b): created successfully Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab592f9-6a5f-43d0-8954-ade8743de422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Flow 'volume_create_manager' (36cdf854-fa03-40cb-994b-b07b85a6ff42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:02 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966 Jun 24 16:10:02 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-17049ffa-89b1-49c0-837d-37cde7927531 tempest-VolumesCloneTest-1835647033 None] Created volume successfully. Jun 24 16:10:02 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56.1b811379-46f3-4cda-b917-decfc8c62966" returned: 0 in 0.653s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1b811379-46f3-4cda-b917-decfc8c62966" released by "_delete_snapshot" :: held 3.144s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1789f1db-434b-45df-a476-8400c0310e56" released by "delete_snapshot" :: held 3.171s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Created reservations ['4972d029-ec6f-4dba-be03-6f037ca40c2d', 'ee3c724d-5b0e-4fab-984c-485d8ddc953b', '4c3d61e1-b161-45a6-bb18-aa3f421c08a1', '215ec188-a6d2-457f-8b83-7edbf85961f9'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Delete snapshot completed successfully. Jun 24 16:10:02 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd 1073741824" returned: 0 in 0.868s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-69848c45-4aab-41ae-9dad-e5817a7b9e9e tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-1b811379-46f3-4cda-b917-decfc8c62966-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:02 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd Jun 24 16:10:02 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:03 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Flow 'volume_create_manager' (43630ee9-4aeb-4475-b103-ee60f6dcb116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb06bcf9-696e-46f2-bea1-2c36c9bc8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd" returned: 0 in 0.694s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.558s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb06bcf9-696e-46f2-bea1-2c36c9bc8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1853500786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6278f87-49fc-4930-aca1-27dacf22bd2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff7440cc7bc455cb7d4e16c1d106660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=05f0b19e-ab23-4d9e-899f-65da133ac15b,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:03Z,use_quota=True,user_id='87f08eb36da2459680f767076c1b6053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebae376-4531-49de-bf84-d763737d4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebae376-4531-49de-bf84-d763737d4f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4734d502-c113-4c03-8dfa-0a1d1d089d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798f73c5-098f-46ca-ad7e-2cd612d4465c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d30237-b421-4cc2-85b3-388e41792bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Creating offline snapshot be620c03-5800-4ed1-99c0-397e7b9bbe1c of volume 6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4734d502-c113-4c03-8dfa-0a1d1d089d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c6278f87-49fc-4930-aca1-27dacf22bd2d', 'volume_name': 'volume-c6278f87-49fc-4930-aca1-27dacf22bd2d', 'volume_size': 2, 'source_volid': '05f0b19e-ab23-4d9e-899f-65da133ac15b', 'source_volstatus': 'available'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1ab38b-cc2c-4423-b016-436dd1a12a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1ab38b-cc2c-4423-b016-436dd1a12a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad328ff-4d8d-487c-9997-b3bba55f76ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:03 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Volume c6278f87-49fc-4930-aca1-27dacf22bd2d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c6278f87-49fc-4930-aca1-27dacf22bd2d', 'volume_size': 2, 'source_volid': '05f0b19e-ab23-4d9e-899f-65da133ac15b', 'source_volstatus': 'available'} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[988f7f7a-7524-4d6c-87df-a48cfc7dbaa5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:03 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Volume volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd (bfb23261-95a2-4d75-a069-29a3d4b68cfd): created successfully Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d30237-b421-4cc2-85b3-388e41792bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Flow 'volume_create_manager' (fd882221-941c-4484-9fab-30e9a33be4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:03 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9da99389-b1dc-4c32-8f6e-6b06bdaa24f7 tempest-AbsoluteLimitsTests-104475690 None] Created volume successfully. Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-1789f1db-434b-45df-a476-8400c0310e56-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-1789f1db-434b-45df-a476-8400c0310e56-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:03 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 Jun 24 16:10:03 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-quobyte-1789f1db-434b-45df-a476-8400c0310e56" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1789f1db-434b-45df-a476-8400c0310e56" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d375ed-f4e0-44aa-b20b-fbdd7966a4b6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:04 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:10:04 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:04 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" returned: 0 in 0.814s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:04 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c 1G Jun 24 16:10:04 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:04 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.829s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:04 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56 Jun 24 16:10:04 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Acquiring lock "cinder-bfb23261-95a2-4d75-a069-29a3d4b68cfd-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Lock "cinder-bfb23261-95a2-4d75-a069-29a3d4b68cfd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Acquiring lock "cinder-quobyte-bfb23261-95a2-4d75-a069-29a3d4b68cfd" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Lock "cinder-quobyte-bfb23261-95a2-4d75-a069-29a3d4b68cfd" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daa139b-1252-41c4-92d4-0fb3ee3c8d56]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:05 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd Jun 24 16:10:05 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:05 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c 1G" returned: 0 in 0.827s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:05 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c Jun 24 16:10:05 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:05 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-1789f1db-434b-45df-a476-8400c0310e56" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-1789f1db-434b-45df-a476-8400c0310e56" released by "delete_volume" :: held 1.593s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Created reservations ['c76c333e-0cc5-48d9-a0ec-9ab35e29b22d', '7437f500-a5c7-4da4-8c38-65d89e504d3c', '94519551-5d83-4eb6-a05f-cbd33bca0d04', '34f60245-f4d4-4cac-9d59-07174c6006c5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:05 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:05 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:05 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd" returned: 0 in 0.805s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:05 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd Jun 24 16:10:05 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-d27f49e8-7a0f-4443-bcc8-a861181b6d51-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:06 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:06 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c is being set with open permissions: ugo+rw Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-d27f49e8-7a0f-4443-bcc8-a861181b6d51-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:06 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c Jun 24 16:10:06 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "cinder-quobyte-d27f49e8-7a0f-4443-bcc8-a861181b6d51" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-d27f49e8-7a0f-4443-bcc8-a861181b6d51" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0150abc-ee7b-4839-9b2c-38f26183f0e5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:06 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 Jun 24 16:10:06 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:06 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.763s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:06 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Deleted volume successfully. Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e4b7b6fa-8715-425e-9922-8fba91eade78 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-1789f1db-434b-45df-a476-8400c0310e56-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:06 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-bfb23261-95a2-4d75-a069-29a3d4b68cfd" returned: 0 in 0.725s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Lock "cinder-quobyte-bfb23261-95a2-4d75-a069-29a3d4b68cfd" released by "delete_volume" :: held 1.584s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Created reservations ['e4d476a7-62e7-4142-a13a-e6899f47c190', '26197169-2391-4dfc-b4f5-ac409487825c', '1985496b-f81d-497c-9d52-60417693d05a', 'c32d47c0-78d3-4909-beef-d0fd7a9c1ede'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:06 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:06 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:06 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c" returned: 0 in 0.703s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:06 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info Jun 24 16:10:06 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:07 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51" returned: 0 in 0.852s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:07 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51 Jun 24 16:10:07 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:07 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.746s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Deleted volume successfully. Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-fe9f0c18-d5ce-423a-a211-9d8f2b73952b tempest-AbsoluteLimitsTests-104475690 None] Lock "cinder-bfb23261-95a2-4d75-a069-29a3d4b68cfd-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:07 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info" returned: 0 in 0.805s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:07 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info is being set with open permissions: ugo+rw Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:07 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info Jun 24 16:10:07 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:07 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d27f49e8-7a0f-4443-bcc8-a861181b6d51" returned: 0 in 0.768s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-quobyte-d27f49e8-7a0f-4443-bcc8-a861181b6d51" released by "delete_volume" :: held 1.676s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Created reservations ['273b7c1e-82de-4a14-8bf6-b66cca1f741f', '266d0f4a-f33a-4d7d-97db-869dba676198', '79b2af33-6818-44ba-ab81-59d7c8e7d848', '8e0864a3-96b7-4b4b-9a32-ceb2d4e4d08e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:08 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:08 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:08 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.info" returned: 0 in 0.749s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.831s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.704s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:08 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Cloning volume 05f0b19e-ab23-4d9e-899f-65da133ac15b to volume c6278f87-49fc-4930-aca1-27dacf22bd2d Jun 24 16:10:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4b1345e7-4350-4d8f-8465-1e165ae0f215 tempest-CinderUnicodeTest-1565901086 None] Create snapshot completed successfully Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Creating offline snapshot c0c898fe-22f9-4b06-bcea-9ecfcece64a7 of volume 05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b8feb5-3a68-4ce7-b620-48a7456339e6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:08 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:08 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:08 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.833s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Deleted volume successfully. Jun 24 16:10:08 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f4b60bfa-eb0f-4850-be9a-7a77491edef7 tempest-SnapshotDependencyTests-1280640013 None] Lock "cinder-d27f49e8-7a0f-4443-bcc8-a861181b6d51-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-be620c03-5800-4ed1-99c0-397e7b9bbe1c-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:09 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 1.042s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-be620c03-5800-4ed1-99c0-397e7b9bbe1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-quobyte-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:09 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 1G Jun 24 16:10:09 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-quobyte-be620c03-5800-4ed1-99c0-397e7b9bbe1c" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-be620c03-5800-4ed1-99c0-397e7b9bbe1c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Deleting offline snapshot be620c03-5800-4ed1-99c0-397e7b9bbe1c of volume 6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] snapshot_file for this snap is: volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5131ff73-d01a-4add-953a-39422374217a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:09 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c Jun 24 16:10:09 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:10 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 1G" returned: 0 in 1.135s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f0b19e-ab23-4d9e-899f-65da133ac15b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:10 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f0b19e-ab23-4d9e-899f-65da133ac15b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 Jun 24 16:10:10 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:10 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c" returned: 0 in 1.067s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[234eb22e-f137-45e0-9b95-74c2d78de3be]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:10 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 Jun 24 16:10:10 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:11 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f0b19e-ab23-4d9e-899f-65da133ac15b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7" returned: 0 in 0.854s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:11 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 is being set with open permissions: ugo+rw Jun 24 16:10:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:11 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 Jun 24 16:10:11 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:11 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" returned: 0 in 1.055s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:11 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c Jun 24 16:10:11 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Flow 'volume_create_manager' (2f25ac5d-2a0b-4b72-9a80-31337d910fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b5e0de-e1dd-40f3-a1ca-729792ed8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b5e0de-e1dd-40f3-a1ca-729792ed8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-918475047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aca56e0-4d06-4b12-94eb-26fb6957a17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a30c01e921441dbad4030eb3701d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:12Z,use_quota=True,user_id='021a96e5bb7b451fb2b014e8e60a07d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04414d8b-5a2c-4d86-ad85-29613729441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04414d8b-5a2c-4d86-ad85-29613729441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b53e3-f239-4550-9188-103d37cf4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0b53e3-f239-4550-9188-103d37cf4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aca56e0-4d06-4b12-94eb-26fb6957a17f', 'volume_name': 'volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abfa408a-5663-4df2-ab0b-1faaa0b748ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abfa408a-5663-4df2-ab0b-1faaa0b748ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4933ec-49c5-46e4-8668-0017d5357c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Volume 4aca56e0-4d06-4b12-94eb-26fb6957a17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f', 'volume_size': 1} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:12 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:12 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info Jun 24 16:10:12 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:12 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c" returned: 0 in 1.031s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:12 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c Jun 24 16:10:12 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:13 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info" returned: 0 in 0.842s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:13 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info is being set with open permissions: ugo+rw Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:13 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info Jun 24 16:10:13 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:13 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336.be620c03-5800-4ed1-99c0-397e7b9bbe1c" returned: 0 in 0.766s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-be620c03-5800-4ed1-99c0-397e7b9bbe1c" released by "_delete_snapshot" :: held 4.128s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" released by "delete_snapshot" :: held 4.155s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Created reservations ['6a59b466-2df6-4039-b7f4-33195e81a63f', '3275c813-df78-4af8-85b4-5b85475683fb', '0f4a29af-411c-432e-bec1-694535341186', 'e63fdb64-0250-49b4-915e-b83d8aa15a83'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Delete snapshot completed successfully. Jun 24 16:10:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c69e45f2-74ea-4656-9115-fb8f951b08f8 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-be620c03-5800-4ed1-99c0-397e7b9bbe1c-delete_snapshot" released by "delete_snapshot" :: held 4.326s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:13 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.info" returned: 0 in 0.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Acquiring lock "cinder-quobyte-c6278f87-49fc-4930-aca1-27dacf22bd2d" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-c6278f87-49fc-4930-aca1-27dacf22bd2d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] snapshot: c0c898fe-22f9-4b06-bcea-9ecfcece64a7, volume: c6278f87-49fc-4930-aca1-27dacf22bd2d, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dbd014-9bd4-4ac5-a01e-80913545b1f5]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:14 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 Jun 24 16:10:14 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:14 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7" returned: 0 in 0.826s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f0b19e-ab23-4d9e-899f-65da133ac15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6fef91-e708-418f-a67b-09ff7d535108]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-quobyte-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:15 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:15 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cafd12-ed85-44d4-87a4-6cba233515f9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:15 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 Jun 24 16:10:15 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:15 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 0.868s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:15 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d Jun 24 16:10:15 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:15 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" returned: 0 in 0.834s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:16 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336 Jun 24 16:10:16 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:16 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" returned: 0 in 0.827s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336" released by "delete_volume" :: held 1.755s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Created reservations ['535d01e1-c995-4225-b8c9-7de71c4ff87f', '1bd47120-a96b-433e-8704-3c52b0f8b646', '8f86ea19-42da-4391-accc-c23b9cd8f3e4', '53b97df0-aa7b-4362-84db-b7528ebd468f'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:17 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:17 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-070c1f6d-6db8-4580-8ed9-066199119f2f-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-070c1f6d-6db8-4580-8ed9-066199119f2f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "cinder-quobyte-070c1f6d-6db8-4580-8ed9-066199119f2f" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-070c1f6d-6db8-4580-8ed9-066199119f2f" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a23dc-de4b-47e4-81a4-1dfc44a3ebcf]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:18 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f Jun 24 16:10:18 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:19 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 2.076s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:19 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Deleted volume successfully. Jun 24 16:10:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e262a668-8d15-41fe-a2bb-0f9980dbf73c tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-6e9e0daf-0c16-4cb5-9a28-76bca4b1f336-delete_volume" released by "delete_volume" :: held 4.365s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:19 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f" returned: 0 in 2.090s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:19 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f Jun 24 16:10:19 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:21 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-070c1f6d-6db8-4580-8ed9-066199119f2f" returned: 0 in 1.644s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-quobyte-070c1f6d-6db8-4580-8ed9-066199119f2f" released by "delete_volume" :: held 3.848s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Created reservations ['064f5e29-09c1-4dae-b08c-b5a2891de336', 'c43516fa-cfc5-4029-b791-e55d1a93bfd2', 'cebfc067-9b21-459f-bdb6-5efde0395721', '598262cf-633e-40b6-939d-6ea03918d7e1'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:21 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:21 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:22 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d" returned: 0 in 6.515s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:22 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c126c58-9949-45d7-a0d4-8b62ebe4cbfb]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:22 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:22 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:22 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.101s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:22 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Deleted volume successfully. Jun 24 16:10:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2b10d461-c7dc-440f-8cf9-2db72844ada0 tempest-CinderUnicodeTest-1565901086 None] Lock "cinder-070c1f6d-6db8-4580-8ed9-066199119f2f-delete_volume" released by "delete_volume" :: held 5.353s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:23 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 1.118s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:23 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:10:23 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Converted 1024.00 MB image at 157.14 MB/s Jun 24 16:10:23 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d is being set with open permissions: ugo+rw Jun 24 16:10:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:23 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d Jun 24 16:10:23 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:24 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d" returned: 0 in 0.685s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-c6278f87-49fc-4930-aca1-27dacf22bd2d" released by "_copy_volume_from_snapshot" :: held 10.123s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Acquiring lock "cinder-quobyte-c0c898fe-22f9-4b06-bcea-9ecfcece64a7" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-c0c898fe-22f9-4b06-bcea-9ecfcece64a7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Deleting offline snapshot c0c898fe-22f9-4b06-bcea-9ecfcece64a7 of volume 05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] snapshot_file for this snap is: volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d8d8fc-80ad-4c42-97b3-7a9ee8339899]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:24 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 Jun 24 16:10:24 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:24 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7" returned: 0 in 0.756s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f0b19e-ab23-4d9e-899f-65da133ac15b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b54a7-d2d7-47e5-8f77-15be3bb28a25]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:25 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:25 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:25 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 0.719s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:25 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 Jun 24 16:10:25 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:26 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7" returned: 0 in 0.706s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:26 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7 Jun 24 16:10:26 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:27 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b.c0c898fe-22f9-4b06-bcea-9ecfcece64a7" returned: 0 in 0.627s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-c0c898fe-22f9-4b06-bcea-9ecfcece64a7" released by "_delete_snapshot" :: held 2.888s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.685s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.899s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-918475047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aca56e0-4d06-4b12-94eb-26fb6957a17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a30c01e921441dbad4030eb3701d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:12Z,use_quota=True,user_id='021a96e5bb7b451fb2b014e8e60a07d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Creating volume 4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:10:27 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:27 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f 1073741824 Jun 24 16:10:27 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad328ff-4d8d-487c-9997-b3bba55f76ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6278f87-49fc-4930-aca1-27dacf22bd2d', 'volume_size': 2, 'source_volid': '05f0b19e-ab23-4d9e-899f-65da133ac15b', 'source_volstatus': 'available'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a3b81-a22b-4cd5-9273-11cac6ba8554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Volume volume-c6278f87-49fc-4930-aca1-27dacf22bd2d (c6278f87-49fc-4930-aca1-27dacf22bd2d): created successfully Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8a3b81-a22b-4cd5-9273-11cac6ba8554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Flow 'volume_create_manager' (43630ee9-4aeb-4475-b103-ee60f6dcb116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:27 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7f5720f0-1f26-4bde-9057-04aaaf7e597e tempest-VolumesCloneTest-1835647033 None] Created volume successfully. Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Acquiring lock "cinder-c6278f87-49fc-4930-aca1-27dacf22bd2d-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Lock "cinder-c6278f87-49fc-4930-aca1-27dacf22bd2d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Acquiring lock "cinder-quobyte-c6278f87-49fc-4930-aca1-27dacf22bd2d" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-c6278f87-49fc-4930-aca1-27dacf22bd2d" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a6c396-861f-48e7-b80e-c12a877d3fde]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:27 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d Jun 24 16:10:27 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:27 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f 1073741824" returned: 0 in 0.831s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:28 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:28 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:28 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d" returned: 0 in 0.770s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:28 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d Jun 24 16:10:28 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:28 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.643s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4933ec-49c5-46e4-8668-0017d5357c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b7c84-bafe-472f-a4e5-717a37e6a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Volume volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f (4aca56e0-4d06-4b12-94eb-26fb6957a17f): created successfully Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179b7c84-bafe-472f-a4e5-717a37e6a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Flow 'volume_create_manager' (2f25ac5d-2a0b-4b72-9a80-31337d910fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-484021fb-65ee-4177-a57d-43779644b47b tempest-VolumesDeleteCascade-321007189 None] Created volume successfully. Jun 24 16:10:29 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c6278f87-49fc-4930-aca1-27dacf22bd2d" returned: 0 in 0.629s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-c6278f87-49fc-4930-aca1-27dacf22bd2d" released by "delete_volume" :: held 1.438s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Created reservations ['1e3ff07d-e48a-4e6c-bc77-71851d088142', '366ce4e9-c290-40e6-a5a4-9bb27526e70a', '1244ccf2-55c1-4d40-86b6-d6ddb30b76f6', 'c2375037-0c04-43f7-8d90-48f8f23bef90'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:29 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:29 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Creating offline snapshot c2da6944-2228-4259-87d4-aa3ca387309f of volume 4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bacd0ca-6444-4f80-baa5-2ddcb934e0c1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:30 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Deleted volume successfully. Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b70cd4b-849e-4a07-933e-c0e0daea58b7 tempest-VolumesCloneTest-1835647033 None] Lock "cinder-c6278f87-49fc-4930-aca1-27dacf22bd2d-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Acquiring lock "cinder-05f0b19e-ab23-4d9e-899f-65da133ac15b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Lock "cinder-05f0b19e-ab23-4d9e-899f-65da133ac15b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:30 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:30 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Acquiring lock "cinder-quobyte-05f0b19e-ab23-4d9e-899f-65da133ac15b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-05f0b19e-ab23-4d9e-899f-65da133ac15b" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e645a4b-dbe0-485b-9a53-2e6839ecceab]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:30 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:30 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:30 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.755s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:30 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f 1G Jun 24 16:10:30 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:30 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:30 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b Jun 24 16:10:30 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:31 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f 1G" returned: 0 in 0.779s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:31 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:31 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:31 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-05f0b19e-ab23-4d9e-899f-65da133ac15b" returned: 0 in 0.670s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Lock "cinder-quobyte-05f0b19e-ab23-4d9e-899f-65da133ac15b" released by "delete_volume" :: held 1.487s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Created reservations ['d3890f39-6d36-43bb-9124-d2cfe3ab3d4c', '1d896a8b-b55b-4274-a45c-1576624d901e', '7c956e07-691b-425a-9c93-133e332bfab3', '1af7cafc-60f1-4886-a0f7-0e6bddc3580f'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:31 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:31 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:32 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:32 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f is being set with open permissions: ugo+rw Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:32 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:32 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:32 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.685s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Deleted volume successfully. Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-b2229b04-c9ef-45f9-bb0e-56abd7a7645a tempest-VolumesCloneTest-1835647033 None] Lock "cinder-05f0b19e-ab23-4d9e-899f-65da133ac15b-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:32 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.646s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:32 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info Jun 24 16:10:32 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:33 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info" returned: 0 in 0.699s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:33 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info is being set with open permissions: ugo+rw Jun 24 16:10:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:33 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info Jun 24 16:10:33 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:34 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.info" returned: 0 in 0.667s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.343s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f463ee0d-f611-41f2-b6dd-0c4e9c75336f tempest-VolumesDeleteCascade-321007189 None] Create snapshot completed successfully Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (7cf2d5f8-d2f3-4b80-a855-2522727e68fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe5088a-ac13-4afe-a3da-c985b61e98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe5088a-ac13-4afe-a3da-c985b61e98bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2037552550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9667aa28-8eac-43a4-b83e-83e7c9a3d1fb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:35Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0c052f-a03a-42ed-954d-fe3dc0135cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0c052f-a03a-42ed-954d-fe3dc0135cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83821abc-2c14-4440-90b5-b52ca23ebbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83821abc-2c14-4440-90b5-b52ca23ebbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9667aa28-8eac-43a4-b83e-83e7c9a3d1fb', 'volume_name': 'volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d835e87-4e53-4e7f-a0a7-48bbcbca7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d835e87-4e53-4e7f-a0a7-48bbcbca7609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3848916-781e-411a-8294-449a87e1e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:35 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Volume 9667aa28-8eac-43a4-b83e-83e7c9a3d1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb', 'volume_size': 1} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2037552550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9667aa28-8eac-43a4-b83e-83e7c9a3d1fb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:35Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Creating volume 9667aa28-8eac-43a4-b83e-83e7c9a3d1fb {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:10:35 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:35 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb 1073741824 Jun 24 16:10:35 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:36 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb 1073741824" returned: 0 in 0.780s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:36 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb Jun 24 16:10:36 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:36 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb" returned: 0 in 0.616s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.401s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3848916-781e-411a-8294-449a87e1e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c44f3ef-04ed-45fe-8307-9ba4e00410be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Creating offline snapshot cfe4fc58-8106-45b2-9716-aa69ed3595e6 of volume 4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:10:36 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Volume volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb (9667aa28-8eac-43a4-b83e-83e7c9a3d1fb): created successfully Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c44f3ef-04ed-45fe-8307-9ba4e00410be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (7cf2d5f8-d2f3-4b80-a855-2522727e68fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4809686b-0cd0-4940-b194-8957e12658ec]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-01ae1cd9-9494-447f-b3a1-9b068eab5882 tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:10:36 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:36 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:37 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:37 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 1G Jun 24 16:10:37 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (d947f341-9ff6-4b59-8a59-ca226b54c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4707cd-ef7f-4074-9247-70f3cb6a2cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4707cd-ef7f-4074-9247-70f3cb6a2cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1792439362',display_name='tempest-VolumesGetTest-Volume-1474546558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65be3fd3-4c32-49db-9664-2c7917a26226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:38Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:37 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2debaa-0579-4b23-b658-4389114bbda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2debaa-0579-4b23-b658-4389114bbda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d74add0-d203-4cbd-9d6a-a14dd2cbf858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d74add0-d203-4cbd-9d6a-a14dd2cbf858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65be3fd3-4c32-49db-9664-2c7917a26226', 'volume_name': 'volume-65be3fd3-4c32-49db-9664-2c7917a26226', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d91ad2-02ec-4d06-b4bb-c7eb766c7850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d91ad2-02ec-4d06-b4bb-c7eb766c7850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3c441f-aed6-442d-bbdf-5ba1cdac82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:38 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Volume 65be3fd3-4c32-49db-9664-2c7917a26226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65be3fd3-4c32-49db-9664-2c7917a26226', 'volume_size': 1} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:38 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 1G" returned: 0 in 0.854s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:38 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 Jun 24 16:10:38 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:39 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6" returned: 0 in 0.675s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:39 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 is being set with open permissions: ugo+rw Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:39 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 Jun 24 16:10:39 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:39 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:39 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:39 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6" returned: 0 in 0.644s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.065s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1792439362',display_name='tempest-VolumesGetTest-Volume-1474546558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65be3fd3-4c32-49db-9664-2c7917a26226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:38Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Creating volume 65be3fd3-4c32-49db-9664-2c7917a26226 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:10:39 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:39 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 1073741824 Jun 24 16:10:39 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1f13ec68-7a41-4e3e-9889-1ae4041ae454 tempest-VolumesDeleteCascade-321007189 None] Create snapshot completed successfully Jun 24 16:10:39 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.684s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:10:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-4aca56e0-4d06-4b12-94eb-26fb6957a17f-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-4aca56e0-4d06-4b12-94eb-26fb6957a17f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Performing cascade delete. {{(pid=93867) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-c2da6944-2228-4259-87d4-aa3ca387309f-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-c2da6944-2228-4259-87d4-aa3ca387309f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:40 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 1073741824" returned: 0 in 0.866s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-c2da6944-2228-4259-87d4-aa3ca387309f" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-c2da6944-2228-4259-87d4-aa3ca387309f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Deleting offline snapshot c2da6944-2228-4259-87d4-aa3ca387309f of volume 4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:10:40 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 Jun 24 16:10:40 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] snapshot_file for this snap is: volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc467cf-741a-402f-98eb-71c2d607eecd]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:40 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:40 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:41 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226" returned: 0 in 0.656s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3c441f-aed6-442d-bbdf-5ba1cdac82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65be3fd3-4c32-49db-9664-2c7917a26226', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dc5993-4ede-4c0a-8f3f-a64f14419ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:41 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Volume volume-65be3fd3-4c32-49db-9664-2c7917a26226 (65be3fd3-4c32-49db-9664-2c7917a26226): created successfully Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23dc5993-4ede-4c0a-8f3f-a64f14419ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (d947f341-9ff6-4b59-8a59-ca226b54c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-28578d4e-50a0-4ddd-9c35-57c19efb9de2 tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:10:41 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd6c659-9043-4441-8da6-cf5e46b5855d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:41 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:41 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-65be3fd3-4c32-49db-9664-2c7917a26226-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Lock "cinder-65be3fd3-4c32-49db-9664-2c7917a26226-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:42 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.769s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[65819f21-ff95-4169-b4d5-415cc06a581f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-65be3fd3-4c32-49db-9664-2c7917a26226" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-65be3fd3-4c32-49db-9664-2c7917a26226" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bef401-5730-423a-93e3-f927ec4e6fbd]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:42 devstack sudo[109768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 Jun 24 16:10:42 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:42 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 Jun 24 16:10:42 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:43 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6" returned: 0 in 0.792s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[20455658-af82-4e82-8e4d-b35ea6d26690]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:43 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226" returned: 0 in 0.785s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:43 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226 Jun 24 16:10:43 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:43 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:43 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:43 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-65be3fd3-4c32-49db-9664-2c7917a26226" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-65be3fd3-4c32-49db-9664-2c7917a26226" released by "delete_volume" :: held 1.491s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Created reservations ['6265fc9e-5620-4f6a-85a8-29993737c8be', '63080f2a-0dae-46fa-b273-a484103ea532', 'b6d225e2-9d59-4c43-b90d-30900dae3d53', '3f5e8919-852b-4df1-bb56-23bb6062d0dd'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:43 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.790s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a086edca-10dd-4ff6-ad15-8e7f3afb0218]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:44 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:44 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:44 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:44 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Lock "cinder-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[752be419-ced4-43ce-9ba7-c8816b5bbb56]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:44 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.695s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:44 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-472b38e7-cd0b-48c1-a2b0-6d5bbbd7af81 tempest-VolumesGetTest-1691652505 None] Lock "cinder-65be3fd3-4c32-49db-9664-2c7917a26226-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:44 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.842s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:44 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb Jun 24 16:10:44 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:44 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:44 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:45 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb" returned: 0 in 0.773s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:45 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb Jun 24 16:10:45 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:45 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.739s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:45 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f Jun 24 16:10:45 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:46 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb" returned: 0 in 0.652s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb" released by "delete_volume" :: held 1.482s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Created reservations ['134c755a-7211-47e5-89af-a9dcd502855e', '09bd6fc7-a51a-4e03-a0fb-72ba7a0da9bd', '6bbfa1e9-a2a3-47d0-8508-3f4c61b17983', '205ce5a3-43ea-4e30-9d0b-c65e86964a1f'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:46 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.c2da6944-2228-4259-87d4-aa3ca387309f" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 -F qcow2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:46 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 -F qcow2 Jun 24 16:10:46 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:46 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:46 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:46 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 -F qcow2" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:46 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-c2da6944-2228-4259-87d4-aa3ca387309f" released by "_delete_snapshot" :: held 6.250s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" released by "delete_snapshot" :: held 6.290s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-22c68b23-c452-4d7b-902a-6689b72fd4df tempest-VolumesGetTest-1691652505 None] Lock "cinder-9667aa28-8eac-43a4-b83e-83e7c9a3d1fb-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Created reservations ['18986260-eb4d-48de-ae98-0fe9ed0049ac', 'ff00e0eb-b97a-478a-8e06-e2408aad51be', 'd2be033d-bcc0-433e-8d0e-d6cca4394375', '0e43e99c-9fbc-4e80-84f6-19c8ff486020'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:47 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Delete snapshot completed successfully. Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-c2da6944-2228-4259-87d4-aa3ca387309f-delete_snapshot" released by "delete_snapshot" :: held 6.473s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-cfe4fc58-8106-45b2-9716-aa69ed3595e6-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-cfe4fc58-8106-45b2-9716-aa69ed3595e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-cfe4fc58-8106-45b2-9716-aa69ed3595e6" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-cfe4fc58-8106-45b2-9716-aa69ed3595e6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Deleting offline snapshot cfe4fc58-8106-45b2-9716-aa69ed3595e6 of volume 4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] snapshot_file for this snap is: volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47886e1-e4d7-4ee6-a7c9-a4820de62d70]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:47 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 Jun 24 16:10:47 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (d21719e1-c3d0-4e97-a2de-a633c3abcd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd42ea8-e745-4f88-a0fa-48914516aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd42ea8-e745-4f88-a0fa-48914516aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1651890105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e591aea-c3f7-49cd-b7c0-d17d618e23bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:47Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8743fa-7d60-4bfd-aba5-3f16aa09230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8743fa-7d60-4bfd-aba5-3f16aa09230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe24e5d-4f43-4fa7-aed9-5aacf8e208a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe24e5d-4f43-4fa7-aed9-5aacf8e208a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'volume_name': 'volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31acf410-7a97-4b25-ae65-5bc9595651dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31acf410-7a97-4b25-ae65-5bc9595651dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac08677-8888-475a-98b5-3f5669e26ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:47 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Volume 5e591aea-c3f7-49cd-b7c0-d17d618e23bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'volume_size': 1} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1651890105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e591aea-c3f7-49cd-b7c0-d17d618e23bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:47Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Creating volume 5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:10:47 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:47 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc 1073741824 Jun 24 16:10:47 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:47 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6" returned: 0 in 0.759s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c501d8-3125-40c9-88aa-8fd3455c6466]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:48 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:48 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:48 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc 1073741824" returned: 0 in 0.813s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:48 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:10:48 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:48 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:48 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 Jun 24 16:10:48 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:48 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac08677-8888-475a-98b5-3f5669e26ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a299866-9563-43b3-8b44-d7070e7313f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Volume volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc (5e591aea-c3f7-49cd-b7c0-d17d618e23bc): created successfully Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a299866-9563-43b3-8b44-d7070e7313f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (d21719e1-c3d0-4e97-a2de-a633c3abcd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-aaef8489-9660-498d-8401-4dac236c36f7 tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:10:49 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6" returned: 0 in 0.813s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:49 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6 Jun 24 16:10:49 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (8e15c7c5-0a93-4f67-9afe-9c88560e3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ba7fd9-8387-476f-b59e-31ac54ca006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ba7fd9-8387-476f-b59e-31ac54ca006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1585777776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c7540e-f3e0-4957-996b-5b818d1107c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5e591aea-c3f7-49cd-b7c0-d17d618e23bc,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:50Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3199d5-2723-4f54-9c82-a3ac7415af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3199d5-2723-4f54-9c82-a3ac7415af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26ac2e1-71a2-41b1-b99e-958989baaeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26ac2e1-71a2-41b1-b99e-958989baaeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '80c7540e-f3e0-4957-996b-5b818d1107c2', 'volume_name': 'volume-80c7540e-f3e0-4957-996b-5b818d1107c2', 'volume_size': 1, 'source_volid': '5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'source_volstatus': 'available'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916072ac-979c-4e09-b09f-d278c456ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916072ac-979c-4e09-b09f-d278c456ce92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b4bfbb-f5a8-4f37-b152-2c1c5b5cdb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:49 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Volume 80c7540e-f3e0-4957-996b-5b818d1107c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-80c7540e-f3e0-4957-996b-5b818d1107c2', 'volume_size': 1, 'source_volid': '5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'source_volstatus': 'available'} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:49 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Cloning volume 5e591aea-c3f7-49cd-b7c0-d17d618e23bc to volume 80c7540e-f3e0-4957-996b-5b818d1107c2 Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Creating offline snapshot a7c48ecf-5b4c-4a1d-bbee-056b51e7573e of volume 5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750e0d3-48e5-4f90-9d10-491d5151a36d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:50 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:10:50 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:50 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f.cfe4fc58-8106-45b2-9716-aa69ed3595e6" returned: 0 in 0.681s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-cfe4fc58-8106-45b2-9716-aa69ed3595e6" released by "_delete_snapshot" :: held 3.126s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" released by "delete_snapshot" :: held 3.147s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Created reservations ['c98e4dee-f608-435d-8665-a1b783c5bc95', '191cf099-c1b6-405b-8eff-d22bb786f066', 'a6ec892e-45e6-4e1b-9247-883f35de5007', '5223b0a3-61a0-4f7c-97f3-9266805e4561'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:50 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Delete snapshot completed successfully. Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-cfe4fc58-8106-45b2-9716-aa69ed3595e6-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Snapshots deleted, issuing volume delete {{(pid=93867) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd343e-0a9f-44bf-8453-0c1adce7b13c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:50 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:50 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:50 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.767s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:50 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e 1G Jun 24 16:10:50 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:51 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.758s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:51 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f Jun 24 16:10:51 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:51 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e 1G" returned: 0 in 0.788s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:51 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e Jun 24 16:10:51 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:51 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-4aca56e0-4d06-4b12-94eb-26fb6957a17f" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-4aca56e0-4d06-4b12-94eb-26fb6957a17f" released by "delete_volume" :: held 1.470s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:51 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Created reservations ['9590420d-b669-47a6-b6c0-5f5a4b8f034a', '66d420fc-4ae9-47e7-8b91-a0804090a7fd', '5085d82e-56c8-439f-a83c-80c1fff1a077', '0892c6f2-9117-4c25-922a-db18fa316840'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:52 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:10:52 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:52 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" returned: 0 in 0.708s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:52 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e is being set with open permissions: ugo+rw Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:52 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e Jun 24 16:10:52 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:52 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:10:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Deleted volume successfully. Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0236db3-de49-4805-a556-4bcb6eef9220 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-4aca56e0-4d06-4b12-94eb-26fb6957a17f-delete_volume" released by "delete_volume" :: held 12.198s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:10:52 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" returned: 0 in 0.676s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:53 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info Jun 24 16:10:53 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Flow 'volume_create_manager' (8519a79a-5b57-4380-868a-a3b9dd514d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1979f5-a90a-48ff-9c98-07498a9ea3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1979f5-a90a-48ff-9c98-07498a9ea3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1364636483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44afa259-8a6b-41a6-95ae-7f092e0b22e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a30c01e921441dbad4030eb3701d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:53Z,use_quota=True,user_id='021a96e5bb7b451fb2b014e8e60a07d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35bc0989-8bc9-414a-827d-dbf4e80f0a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35bc0989-8bc9-414a-827d-dbf4e80f0a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33be296b-b89b-468f-9cd1-105463613444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33be296b-b89b-468f-9cd1-105463613444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44afa259-8a6b-41a6-95ae-7f092e0b22e7', 'volume_name': 'volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a81c501-2647-4f05-9a3a-5c825b75a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a81c501-2647-4f05-9a3a-5c825b75a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3a55ff-d7e2-4eee-89e0-c1f92c3faa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:10:53 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Volume 44afa259-8a6b-41a6-95ae-7f092e0b22e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7', 'volume_size': 1} Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:53 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info" returned: 0 in 0.642s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:53 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info is being set with open permissions: ugo+rw Jun 24 16:10:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:53 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info Jun 24 16:10:53 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:54 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.info" returned: 0 in 0.627s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-80c7540e-f3e0-4957-996b-5b818d1107c2" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-80c7540e-f3e0-4957-996b-5b818d1107c2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] snapshot: a7c48ecf-5b4c-4a1d-bbee-056b51e7573e, volume: 80c7540e-f3e0-4957-996b-5b818d1107c2, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[39875ed8-4a51-416b-9221-18a9e6511cd9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:54 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e Jun 24 16:10:54 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:55 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" returned: 0 in 0.723s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ba8dc-12c0-4ad8-9d5d-516134f3e52d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:55 devstack sudo[109887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:10:55 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:10:55 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.740s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:10:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:10:55 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 Jun 24 16:10:55 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:00 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2" returned: 0 in 4.432s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:00 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdebab-9d34-44f8-9f9a-2b55685f1be3]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:00 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:11:00 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:01 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.915s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:11:01 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Converted 1024.00 MB image at 230.97 MB/s Jun 24 16:11:01 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 is being set with open permissions: ugo+rw Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:01 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 Jun 24 16:11:01 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:01 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2" returned: 0 in 0.612s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-80c7540e-f3e0-4957-996b-5b818d1107c2" released by "_copy_volume_from_snapshot" :: held 7.495s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=109,cinder:UPDATE=139,cinder:DELETE=11,cinder:INSERT=35 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Deleting offline snapshot a7c48ecf-5b4c-4a1d-bbee-056b51e7573e of volume 5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] snapshot_file for this snap is: volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab602787-f27c-4f11-ac9f-0a07c9533c84]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:01 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e Jun 24 16:11:01 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:02 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" returned: 0 in 0.736s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:11:02 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b186abee-ed7d-4052-a3b5-ec42f13d7360]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:02 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:11:02 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:03 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=95,cinder:UPDATE=123,cinder:INSERT=34,cinder:DELETE=10 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:11:03 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.719s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:03 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e Jun 24 16:11:03 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:04 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" returned: 0 in 0.724s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:04 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e Jun 24 16:11:04 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:04 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc.a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" returned: 0 in 0.616s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-a7c48ecf-5b4c-4a1d-bbee-056b51e7573e" released by "_delete_snapshot" :: held 2.886s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.765s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.625s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1364636483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44afa259-8a6b-41a6-95ae-7f092e0b22e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a30c01e921441dbad4030eb3701d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:10:53Z,use_quota=True,user_id='021a96e5bb7b451fb2b014e8e60a07d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Creating volume 44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:04 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b4bfbb-f5a8-4f37-b152-2c1c5b5cdb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c7540e-f3e0-4957-996b-5b818d1107c2', 'volume_size': 1, 'source_volid': '5e591aea-c3f7-49cd-b7c0-d17d618e23bc', 'source_volstatus': 'available'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:04 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 1073741824 Jun 24 16:11:04 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48832773-9fdb-47ca-8295-9a4c7ff9779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Volume volume-80c7540e-f3e0-4957-996b-5b818d1107c2 (80c7540e-f3e0-4957-996b-5b818d1107c2): created successfully Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48832773-9fdb-47ca-8295-9a4c7ff9779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (8e15c7c5-0a93-4f67-9afe-9c88560e3058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:04 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d6f8518b-cd16-44b8-b622-6f24bba36dad tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:11:05 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 1073741824" returned: 0 in 0.815s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:05 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:05 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (6a4aff05-501e-4b5c-918e-a748e4485f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5225264-b9e8-4fe3-8331-d7efe3bf353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5225264-b9e8-4fe3-8331-d7efe3bf353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1007550951',display_name='tempest-VolumesGetTest-Volume-1333234234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ce763a-25d9-41ac-952c-f356bfee834f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:06Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3106fac-36f6-412f-bfb4-1e25c707c420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3106fac-36f6-412f-bfb4-1e25c707c420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c009c6-eb18-476b-8f23-4c7a9211f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c009c6-eb18-476b-8f23-4c7a9211f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ce763a-25d9-41ac-952c-f356bfee834f', 'volume_name': 'volume-19ce763a-25d9-41ac-952c-f356bfee834f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd434453-ba6e-441e-9621-488ed50251dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd434453-ba6e-441e-9621-488ed50251dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8a79d9-6c62-4d4f-a2e3-8acf594e2199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Volume 19ce763a-25d9-41ac-952c-f356bfee834f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ce763a-25d9-41ac-952c-f356bfee834f', 'volume_size': 1} Jun 24 16:11:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:06 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.640s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1007550951',display_name='tempest-VolumesGetTest-Volume-1333234234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ce763a-25d9-41ac-952c-f356bfee834f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:06Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Creating volume 19ce763a-25d9-41ac-952c-f356bfee834f {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:06 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3a55ff-d7e2-4eee-89e0-c1f92c3faa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:06 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f 1073741824 Jun 24 16:11:06 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b293f2b-aabb-48bc-bc8b-681cdbba3e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:06 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Volume volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 (44afa259-8a6b-41a6-95ae-7f092e0b22e7): created successfully Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b293f2b-aabb-48bc-bc8b-681cdbba3e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Flow 'volume_create_manager' (8519a79a-5b57-4380-868a-a3b9dd514d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:06 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-fd78dee8-535d-474c-9d6b-36487ede479d tempest-VolumesDeleteCascade-321007189 None] Created volume successfully. Jun 24 16:11:07 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f 1073741824" returned: 0 in 0.797s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:07 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f Jun 24 16:11:07 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:07 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f" returned: 0 in 0.626s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.598s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Creating offline snapshot dde6624f-ce63-46ea-81c9-f28e648cb020 of volume 44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8a79d9-6c62-4d4f-a2e3-8acf594e2199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ce763a-25d9-41ac-952c-f356bfee834f', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5658345-465c-4c88-8f96-a6c2e65be611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0c5daf-92cb-4070-81d4-5db13a6697b2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Volume volume-19ce763a-25d9-41ac-952c-f356bfee834f (19ce763a-25d9-41ac-952c-f356bfee834f): created successfully Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5658345-465c-4c88-8f96-a6c2e65be611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (6a4aff05-501e-4b5c-918e-a748e4485f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e94202b5-bc53-44bf-b49e-997cb6cd797c tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:11:07 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:07 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:08 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.731s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:08 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 1G Jun 24 16:11:08 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-19ce763a-25d9-41ac-952c-f356bfee834f-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Lock "cinder-19ce763a-25d9-41ac-952c-f356bfee834f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-19ce763a-25d9-41ac-952c-f356bfee834f" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-19ce763a-25d9-41ac-952c-f356bfee834f" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a66e12a-957b-4235-bc0b-4b4bdaee03d9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:09 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f Jun 24 16:11:09 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:09 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 1G" returned: 0 in 0.810s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:09 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 Jun 24 16:11:09 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:09 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f" returned: 0 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:09 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f Jun 24 16:11:09 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:09 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020" returned: 0 in 0.667s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:09 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 is being set with open permissions: ugo+rw Jun 24 16:11:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:10 devstack sudo[110013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 Jun 24 16:11:10 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:10 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-19ce763a-25d9-41ac-952c-f356bfee834f" returned: 0 in 0.621s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-19ce763a-25d9-41ac-952c-f356bfee834f" released by "delete_volume" :: held 1.396s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Created reservations ['43576eb1-c885-4341-986f-8bbfb35cac32', 'd4dec794-85c8-454c-9f5a-573222075a85', '2a5beb6a-811f-42ad-82c6-b6006be749eb', '564e8bbe-3bc5-443b-ab60-a61f68e9af13'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:10 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020" returned: 0 in 0.685s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:10 devstack sudo[110017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:10 devstack sudo[110017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:10 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info Jun 24 16:11:10 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:11 devstack sudo[110017]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.639s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:11 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ce0896e7-d992-4813-901d-684938f4a40f tempest-VolumesGetTest-1691652505 None] Lock "cinder-19ce763a-25d9-41ac-952c-f356bfee834f-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:11 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info" returned: 0 in 0.666s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:11 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info is being set with open permissions: ugo+rw Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-80c7540e-f3e0-4957-996b-5b818d1107c2-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:11 devstack sudo[110023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info Jun 24 16:11:11 devstack sudo[110023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Lock "cinder-80c7540e-f3e0-4957-996b-5b818d1107c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-80c7540e-f3e0-4957-996b-5b818d1107c2" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-80c7540e-f3e0-4957-996b-5b818d1107c2" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[479af9f2-56a1-4bce-83ff-1de558db88db]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:11 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 Jun 24 16:11:11 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:11 devstack sudo[110023]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.info" returned: 0 in 0.624s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:12 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-716f4a56-874f-4791-a879-4c8f53271316 tempest-VolumesDeleteCascade-321007189 None] Create snapshot completed successfully Jun 24 16:11:12 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2" returned: 0 in 0.768s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:12 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2 Jun 24 16:11:12 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:12 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-80c7540e-f3e0-4957-996b-5b818d1107c2" returned: 0 in 0.647s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Flow 'volume_create_manager' (5a69e8d8-e737-4f71-98eb-4210518fa36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb3ad81-5cd8-4d55-b22e-1f0388909e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-80c7540e-f3e0-4957-996b-5b818d1107c2" released by "delete_volume" :: held 1.482s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb3ad81-5cd8-4d55-b22e-1f0388909e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1434651228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdbc1d2-8d74-431b-b78a-753acd4b2875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a30c01e921441dbad4030eb3701d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dde6624f-ce63-46ea-81c9-f28e648cb020,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:13Z,use_quota=True,user_id='021a96e5bb7b451fb2b014e8e60a07d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17999a25-d35e-4250-961f-b9872268cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17999a25-d35e-4250-961f-b9872268cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9837cab6-a573-4bc7-a1fa-529b38fb80ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9837cab6-a573-4bc7-a1fa-529b38fb80ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8bdbc1d2-8d74-431b-b78a-753acd4b2875', 'volume_name': 'volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875', 'volume_size': 1, 'snapshot_id': 'dde6624f-ce63-46ea-81c9-f28e648cb020'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba893f5a-d675-497d-b71f-ba0cc6429eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba893f5a-d675-497d-b71f-ba0cc6429eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5822d31c-111a-49ec-9110-2854a8167a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Volume 8bdbc1d2-8d74-431b-b78a-753acd4b2875: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875', 'volume_size': 1, 'snapshot_id': 'dde6624f-ce63-46ea-81c9-f28e648cb020'} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-dde6624f-ce63-46ea-81c9-f28e648cb020-8bdbc1d2-8d74-431b-b78a-753acd4b2875" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-dde6624f-ce63-46ea-81c9-f28e648cb020-8bdbc1d2-8d74-431b-b78a-753acd4b2875" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Creating volume 8bdbc1d2-8d74-431b-b78a-753acd4b2875 from snapshot dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-8bdbc1d2-8d74-431b-b78a-753acd4b2875" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-8bdbc1d2-8d74-431b-b78a-753acd4b2875" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] snapshot: dde6624f-ce63-46ea-81c9-f28e648cb020, volume: 8bdbc1d2-8d74-431b-b78a-753acd4b2875, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Created reservations ['d181fe4b-51af-4bd3-88ea-4cd17cab6cd1', '051b683b-1c23-4167-84ee-4ca421898b98', '29c1862c-82a5-4184-9ed4-fa900e61232d', '19b3bcfa-1034-4642-a91b-eb94f32b0eaf'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b690e1-0b66-4ee1-9643-3267dc68b265]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:13 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:13 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:13 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 Jun 24 16:11:13 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-5e591aea-c3f7-49cd-b7c0-d17d618e23bc-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Lock "cinder-5e591aea-c3f7-49cd-b7c0-d17d618e23bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2960e308-7bd7-46d5-82fc-8eb591fdefd4]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:13 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.703s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1163c6e8-45ae-4ec7-b485-4fbe837243ab tempest-VolumesGetTest-1691652505 None] Lock "cinder-80c7540e-f3e0-4957-996b-5b818d1107c2-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:13 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020" returned: 0 in 0.856s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49b4c4-01bd-4272-8908-ba2617fa28b8]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:13 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:11:13 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:14 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:14 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:14 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.743s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:14 devstack sudo[110052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc Jun 24 16:11:14 devstack sudo[110052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:14 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.793s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:14 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:11:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:14 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 Jun 24 16:11:14 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:15 devstack sudo[110052]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-5e591aea-c3f7-49cd-b7c0-d17d618e23bc" released by "delete_volume" :: held 1.485s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Created reservations ['47dca563-5094-4c06-9bf7-d2cfb1e46c01', '581427e3-4b17-4556-8a3e-d52855d9ee8d', 'e9889cef-22d1-4337-a6e9-9cd5a5bcec3d', 'bd7c43e0-5f2b-4317-91b1-e9d66b4d33e7'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:15 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:15 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:16 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.321s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:16 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:11:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-c31207d9-b26a-47a7-a8af-c6c8c4c2c058 tempest-VolumesGetTest-1691652505 None] Lock "cinder-5e591aea-c3f7-49cd-b7c0-d17d618e23bc-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (c4608e5f-3063-474d-a828-ce1c1814ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d72735-6d4a-4c93-9f50-fa2184e8d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d72735-6d4a-4c93-9f50-fa2184e8d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1765176692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d06c095-36ca-43f9-89ad-4c034dccf865,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:18Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931eebaa-7e03-4539-b3d4-2c180c55372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931eebaa-7e03-4539-b3d4-2c180c55372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff02ec2-3734-4ea6-9160-7910fddd238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:18 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff02ec2-3734-4ea6-9160-7910fddd238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d06c095-36ca-43f9-89ad-4c034dccf865', 'volume_name': 'volume-6d06c095-36ca-43f9-89ad-4c034dccf865', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74236a9-498b-41c0-9e37-e935848ffb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74236a9-498b-41c0-9e37-e935848ffb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efde2caa-c091-4b74-a5fb-cca3c5585060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:19 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Volume 6d06c095-36ca-43f9-89ad-4c034dccf865: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d06c095-36ca-43f9-89ad-4c034dccf865', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Trying to clone 6d06c095-36ca-43f9-89ad-4c034dccf865 from image cec30253-e3a4-40e1-82d3-11c0f2e0458f at location (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:11:19 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Image download 20.69 MB at 20.69 MB/s Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2fb35c-e7b4-4757-a7e3-a5077ec4bd6c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:20 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875" returned: 0 in 5.297s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[db08c9aa-309d-4341-b343-514915ad1c62]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:20 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD Jun 24 16:11:20 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:20 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:20 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:20 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f is fetched for user c5dbc52d6d5a4d1f8ec1211d72a9ec3f. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[27046157-aef2-415f-a088-4462944e1575]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:20 devstack sudo[110083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD Jun 24 16:11:20 devstack sudo[110083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:21 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.942s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:11:21 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Converted 1024.00 MB image at 193.25 MB/s Jun 24 16:11:21 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 is being set with open permissions: ugo+rw Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:21 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 Jun 24 16:11:21 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:21 devstack sudo[110083]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:21 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875" returned: 0 in 0.652s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-8bdbc1d2-8d74-431b-b78a-753acd4b2875" released by "_copy_volume_from_snapshot" :: held 8.637s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-dde6624f-ce63-46ea-81c9-f28e648cb020-8bdbc1d2-8d74-431b-b78a-753acd4b2875" released by "_create_volume_from_snapshot" :: held 8.669s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.687s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1765176692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d06c095-36ca-43f9-89ad-4c034dccf865,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:18Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Creating volume 6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:21 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:21 devstack sudo[110092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 1073741824 Jun 24 16:11:21 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5822d31c-111a-49ec-9110-2854a8167a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875', 'volume_size': 1, 'snapshot_id': 'dde6624f-ce63-46ea-81c9-f28e648cb020'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1b00e2-e185-4df9-b849-0d9625fc47c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:21 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Volume volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 (8bdbc1d2-8d74-431b-b78a-753acd4b2875): created successfully Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1b00e2-e185-4df9-b849-0d9625fc47c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Flow 'volume_create_manager' (5a69e8d8-e737-4f71-98eb-4210518fa36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-64bab7dc-8ced-499b-9190-03b66858a3df tempest-VolumesDeleteCascade-321007189 None] Created volume successfully. Jun 24 16:11:22 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 1073741824" returned: 0 in 0.820s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:22 devstack sudo[110098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:22 devstack sudo[110098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-44afa259-8a6b-41a6-95ae-7f092e0b22e7-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-44afa259-8a6b-41a6-95ae-7f092e0b22e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Performing cascade delete. {{(pid=93867) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-dde6624f-ce63-46ea-81c9-f28e648cb020-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-dde6624f-ce63-46ea-81c9-f28e648cb020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-44afa259-8a6b-41a6-95ae-7f092e0b22e7" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-44afa259-8a6b-41a6-95ae-7f092e0b22e7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-dde6624f-ce63-46ea-81c9-f28e648cb020" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-dde6624f-ce63-46ea-81c9-f28e648cb020" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Deleting offline snapshot dde6624f-ce63-46ea-81c9-f28e648cb020 of volume 44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] snapshot_file for this snap is: volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0436ce5-6a2e-467c-ad0d-d15787df9f56]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:23 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 Jun 24 16:11:23 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:23 devstack sudo[110098]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 0 in 0.654s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Attempting download of cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume 6d06c095-36ca-43f9-89ad-4c034dccf865. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d7053-8e45-4231-8c56-adf944ba2901]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:23 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv Jun 24 16:11:23 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:23 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020" returned: 0 in 0.791s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c8846-36cb-464e-ac8f-d1dc384bd822]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:23 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:23 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:24 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv" returned: 0 in 0.740s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:24 devstack sudo[110113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv Jun 24 16:11:24 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:24 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.755s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:24 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 Jun 24 16:11:24 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:24 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv" returned: 1 in 0.718s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cec30253-e3a4-40e1-82d3-11c0f2e0458f_cf2u1akv' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9850737-d348-435b-bc50-1293e22d58cf]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:24 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD Jun 24 16:11:24 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:25 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:25 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020 Jun 24 16:11:25 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:25 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] cec30253-e3a4-40e1-82d3-11c0f2e0458f was qcow2, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:25 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:25 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:25 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7.dde6624f-ce63-46ea-81c9-f28e648cb020" returned: 0 in 0.643s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-dde6624f-ce63-46ea-81c9-f28e648cb020" released by "_delete_snapshot" :: held 3.042s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-44afa259-8a6b-41a6-95ae-7f092e0b22e7" released by "delete_snapshot" :: held 3.067s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Created reservations ['ec54ab2e-d0f2-40cb-98cb-dc0dc24ce379', '53790f28-f263-4576-813b-9c23229b91e5', 'bc67d2d6-0663-4520-94f3-7fefcee429de', 'f41f853f-c7ed-4c79-8fee-435948b79906'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:26 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Delete snapshot completed successfully. Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-dde6624f-ce63-46ea-81c9-f28e648cb020-delete_snapshot" released by "delete_snapshot" :: held 3.225s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Snapshots deleted, issuing volume delete {{(pid=93867) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-44afa259-8a6b-41a6-95ae-7f092e0b22e7" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-44afa259-8a6b-41a6-95ae-7f092e0b22e7" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c93559-b216-4dd8-997a-d44acdc64a53]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:26 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:26 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:26 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.826s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:26 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7 Jun 24 16:11:26 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:27 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 0 in 1.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cec30253-e3a4-40e1-82d3-11c0f2e0458f_faorow8mdevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:11:27 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Converted 112.00 MB image at 62.13 MB/s Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:27 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 1G Jun 24 16:11:27 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:27 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-44afa259-8a6b-41a6-95ae-7f092e0b22e7" returned: 0 in 0.708s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-44afa259-8a6b-41a6-95ae-7f092e0b22e7" released by "delete_volume" :: held 1.605s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Created reservations ['8d528888-0053-4040-bb6b-a9065dd2c2c2', '7138f538-81c9-49e1-a041-02cbf488dc13', '801cd150-217b-4406-956b-8b635a51954b', '6a320c1e-834a-4dec-9ddd-02f75521e3ce'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:27 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:27 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:27 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 1G" returned: 0 in 0.663s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[489d87cc-5038-44c8-a5e9-7dab11e3a54f]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:28 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:28 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-8bdbc1d2-8d74-431b-b78a-753acd4b2875-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-8bdbc1d2-8d74-431b-b78a-753acd4b2875-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "cinder-quobyte-8bdbc1d2-8d74-431b-b78a-753acd4b2875" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-8bdbc1d2-8d74-431b-b78a-753acd4b2875" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea1afe8-3bf4-40c0-9ed2-da3579a41cd4]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:28 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.702s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Deleted volume successfully. Jun 24 16:11:28 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 Jun 24 16:11:28 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e05d3b01-a8bc-4397-be04-9078d9c18b89 tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-44afa259-8a6b-41a6-95ae-7f092e0b22e7-delete_volume" released by "delete_volume" :: held 5.772s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:28 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 0 in 0.740s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:28 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:28 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:29 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:29 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875 Jun 24 16:11:29 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:29 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 1 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Downloaded image cec30253-e3a4-40e1-82d3-11c0f2e0458f ((None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}])) to volume 6d06c095-36ca-43f9-89ad-4c034dccf865 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Temporary image cec30253-e3a4-40e1-82d3-11c0f2e0458f for user c5dbc52d6d5a4d1f8ec1211d72a9ec3f is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Marking volume 6d06c095-36ca-43f9-89ad-4c034dccf865 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Copying metadata from image cec30253-e3a4-40e1-82d3-11c0f2e0458f to 6d06c095-36ca-43f9-89ad-4c034dccf865. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Creating volume glance metadata for volume 6d06c095-36ca-43f9-89ad-4c034dccf865 backed by image cec30253-e3a4-40e1-82d3-11c0f2e0458f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efde2caa-c091-4b74-a5fb-cca3c5585060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d06c095-36ca-43f9-89ad-4c034dccf865', 'volume_size': 1, 'image_id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '046fb53614714e64abd7cdae0fdad60c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cec30253-e3a4-40e1-82d3-11c0f2e0458f', 'created_at': datetime.datetime(2026, 6, 24, 13, 48, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 13, 48, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cec30253-e3a4-40e1-82d3-11c0f2e0458f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811b13b0-b978-4c1b-9cc5-23d1d59ef518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:29 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Volume volume-6d06c095-36ca-43f9-89ad-4c034dccf865 (6d06c095-36ca-43f9-89ad-4c034dccf865): created successfully Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811b13b0-b978-4c1b-9cc5-23d1d59ef518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (c4608e5f-3063-474d-a828-ce1c1814ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:29 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f2ae593d-42f9-4a6d-b1d8-23cd7520851b tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:11:29 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-8bdbc1d2-8d74-431b-b78a-753acd4b2875" returned: 0 in 0.667s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-quobyte-8bdbc1d2-8d74-431b-b78a-753acd4b2875" released by "delete_volume" :: held 1.520s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:29 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Created reservations ['4658ec41-3d18-4161-a000-0bc7c40c436f', '94cafb86-4aa5-4054-b01b-fce5b5367e48', 'fb7b7c5b-0175-41f7-bd7a-4a845ebcb4dc', 'c374b82f-6366-43af-ae8c-3fe68e390e9f'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:30 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:30 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (79724535-7b16-435e-8703-4e39f9860922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f0dc25-32e9-4362-81f4-d5ae167a30d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f0dc25-32e9-4362-81f4-d5ae167a30d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1652633190',display_name='tempest-VolumesGetTest-Volume-424263457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb5015b-567e-4c1e-85ab-99e15875888a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:31Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c726505-cdba-45f0-84be-4f9edc993a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c726505-cdba-45f0-84be-4f9edc993a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b35735a-0c17-4ecf-ae34-9a7a5294486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b35735a-0c17-4ecf-ae34-9a7a5294486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb5015b-567e-4c1e-85ab-99e15875888a', 'volume_name': 'volume-afb5015b-567e-4c1e-85ab-99e15875888a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:30 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48be23a-900f-4adb-bed3-7fc5edc1d077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48be23a-900f-4adb-bed3-7fc5edc1d077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb01b22a-9a0f-4ed3-b270-af2016f31f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:30 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Volume afb5015b-567e-4c1e-85ab-99e15875888a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb5015b-567e-4c1e-85ab-99e15875888a', 'volume_size': 1} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1652633190',display_name='tempest-VolumesGetTest-Volume-424263457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb5015b-567e-4c1e-85ab-99e15875888a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d8746335274ad2bad6233dd01971bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:31Z,use_quota=True,user_id='c5dbc52d6d5a4d1f8ec1211d72a9ec3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Creating volume afb5015b-567e-4c1e-85ab-99e15875888a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:30 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.721s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Deleted volume successfully. Jun 24 16:11:30 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a 1073741824 Jun 24 16:11:30 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-2c63c393-fbb6-4e29-b155-a4561337cbba tempest-VolumesDeleteCascade-321007189 None] Lock "cinder-8bdbc1d2-8d74-431b-b78a-753acd4b2875-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:31 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a 1073741824" returned: 0 in 0.966s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:31 devstack sudo[110192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a Jun 24 16:11:31 devstack sudo[110192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:32 devstack sudo[110192]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a" returned: 0 in 0.637s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb01b22a-9a0f-4ed3-b270-af2016f31f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb5015b-567e-4c1e-85ab-99e15875888a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f84842e-ecb4-4e21-9028-71db4b1dec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:32 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Volume volume-afb5015b-567e-4c1e-85ab-99e15875888a (afb5015b-567e-4c1e-85ab-99e15875888a): created successfully Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f84842e-ecb4-4e21-9028-71db4b1dec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Flow 'volume_create_manager' (79724535-7b16-435e-8703-4e39f9860922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-076624ea-3ba1-4963-9026-8131e1b5ed15 tempest-VolumesGetTest-1691652505 None] Created volume successfully. Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-afb5015b-567e-4c1e-85ab-99e15875888a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Lock "cinder-afb5015b-567e-4c1e-85ab-99e15875888a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-afb5015b-567e-4c1e-85ab-99e15875888a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-afb5015b-567e-4c1e-85ab-99e15875888a" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ade88-db89-4f4b-88de-e9294b5deb0c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:33 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a Jun 24 16:11:33 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Flow 'volume_create_manager' (8f470923-eda4-4816-b339-c6643c1dcfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba2a11c-3ea4-49a4-86fd-7e9468c4a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba2a11c-3ea4-49a4-86fd-7e9468c4a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1221792905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab92315-aea7-4cdc-9c18-347a3d0d0e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e8f0bba4a458da232a95a8feea5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:34Z,use_quota=True,user_id='a1e4a9d637c64059991b4fec50fdea6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43adfa6-3b9f-4341-9816-7031586c99dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43adfa6-3b9f-4341-9816-7031586c99dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1458d4-3f42-4091-a308-588fd251184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1458d4-3f42-4091-a308-588fd251184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab92315-aea7-4cdc-9c18-347a3d0d0e2b', 'volume_name': 'volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affc984d-1313-45f5-9d6c-501e697909d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affc984d-1313-45f5-9d6c-501e697909d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc545a1-beef-405d-b912-594c553544c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Volume dab92315-aea7-4cdc-9c18-347a3d0d0e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b', 'volume_size': 1} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1221792905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab92315-aea7-4cdc-9c18-347a3d0d0e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1e8f0bba4a458da232a95a8feea5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:34Z,use_quota=True,user_id='a1e4a9d637c64059991b4fec50fdea6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Creating volume dab92315-aea7-4cdc-9c18-347a3d0d0e2b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:33 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:33 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a" returned: 0 in 0.824s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:33 devstack sudo[110201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b 1073741824 Jun 24 16:11:33 devstack sudo[110201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:33 devstack sudo[110202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a Jun 24 16:11:33 devstack sudo[110202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:34 devstack sudo[110202]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-afb5015b-567e-4c1e-85ab-99e15875888a" returned: 0 in 0.666s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-afb5015b-567e-4c1e-85ab-99e15875888a" released by "delete_volume" :: held 1.532s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Created reservations ['affbf66d-ef39-4faa-b930-158b198b55f2', '3267f97f-a282-4d49-ab60-406d1685b951', 'c70c9030-8018-40cd-84e1-d053bee576b7', 'd8b2896f-e3b5-45bc-a12a-ddf2e73d5a26'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:34 devstack sudo[110201]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b 1073741824" returned: 0 in 0.840s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:34 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:34 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:34 devstack sudo[110212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b Jun 24 16:11:34 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-6d06c095-36ca-43f9-89ad-4c034dccf865-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Lock "cinder-6d06c095-36ca-43f9-89ad-4c034dccf865-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Acquiring lock "cinder-quobyte-6d06c095-36ca-43f9-89ad-4c034dccf865" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:35 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-6d06c095-36ca-43f9-89ad-4c034dccf865" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.681s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-a0cb0d5b-26c1-4279-a426-0b96dadb5274 tempest-VolumesGetTest-1691652505 None] Lock "cinder-afb5015b-567e-4c1e-85ab-99e15875888a-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:35 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabf0060-02b6-42f9-8ed2-05c7e1485f4c]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc545a1-beef-405d-b912-594c553544c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fb8377-2715-4cd8-8090-9de3daebc33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:35 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Volume volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b (dab92315-aea7-4cdc-9c18-347a3d0d0e2b): created successfully Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57fb8377-2715-4cd8-8090-9de3daebc33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Flow 'volume_create_manager' (8f470923-eda4-4816-b339-c6643c1dcfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-dea6d1e9-75c5-4386-9ccb-e7e796ed29df tempest-VolumesMetadataTest-1226194027 None] Created volume successfully. Jun 24 16:11:35 devstack sudo[110216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:35 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:36 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 0 in 0.764s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:36 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:36 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Acquiring lock "cinder-dab92315-aea7-4cdc-9c18-347a3d0d0e2b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Lock "cinder-dab92315-aea7-4cdc-9c18-347a3d0d0e2b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Acquiring lock "cinder-quobyte-dab92315-aea7-4cdc-9c18-347a3d0d0e2b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Lock "cinder-quobyte-dab92315-aea7-4cdc-9c18-347a3d0d0e2b" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af239e1-bec0-4907-966e-46d752ee5894]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:36 devstack sudo[110222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b Jun 24 16:11:36 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:36 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 1 in 0.791s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:11:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:36 devstack sudo[110227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865 Jun 24 16:11:36 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:37 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b" returned: 0 in 0.775s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:37 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b Jun 24 16:11:37 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:37 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6d06c095-36ca-43f9-89ad-4c034dccf865" returned: 0 in 0.663s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Lock "cinder-quobyte-6d06c095-36ca-43f9-89ad-4c034dccf865" released by "delete_volume" :: held 2.305s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Created reservations ['e6efdf38-1d6e-479b-a58c-99d8e6a59345', 'e8d9860e-4c1e-4965-9208-ee33d1ee0697', '03333ba8-71a8-4439-9ed8-968eeb2e9518', 'cb7876f1-562f-4933-af56-ddfa4fba7ef4'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:37 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:37 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:37 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-dab92315-aea7-4cdc-9c18-347a3d0d0e2b" returned: 0 in 0.680s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Lock "cinder-quobyte-dab92315-aea7-4cdc-9c18-347a3d0d0e2b" released by "delete_volume" :: held 1.503s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Created reservations ['4a8eec7d-12da-4d78-b9dd-c359da7e1d6c', '7fd45dcf-27e0-4035-a574-af4e8dd7a94a', '3837ec14-7e04-4af4-aa4f-1e9008d37c51', '02f43791-b7e4-406d-8cb3-0da638878670'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:38 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:38 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:38 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:38 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Deleted volume successfully. Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d9f5beec-931f-4d6f-912b-feedf6092984 tempest-VolumesGetTest-1691652505 None] Lock "cinder-6d06c095-36ca-43f9-89ad-4c034dccf865-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:38 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.693s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:38 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Deleted volume successfully. Jun 24 16:11:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-61ee6b9f-1cc0-4d21-8ce1-073a78b584e4 tempest-VolumesMetadataTest-1226194027 None] Lock "cinder-dab92315-aea7-4cdc-9c18-347a3d0d0e2b-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:39 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:39 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:40 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.794s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:11:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:11:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Flow 'volume_create_manager' (1846723f-885d-470d-92d9-f1a96a4dfcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e03576a-3448-4484-a1e3-f6eff9b43273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e03576a-3448-4484-a1e3-f6eff9b43273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1338729566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399d533b-b311-491f-b21f-951ea859f049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96f47185172c41ef89c79f508eadcd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:44Z,use_quota=True,user_id='9a0a61b3dfa2466a9d391e42eb3eb296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24955976-96bc-47e0-818e-8f7b47611a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24955976-96bc-47e0-818e-8f7b47611a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3ce8df-1c85-4440-92f1-fc76c010811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3ce8df-1c85-4440-92f1-fc76c010811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399d533b-b311-491f-b21f-951ea859f049', 'volume_name': 'volume-399d533b-b311-491f-b21f-951ea859f049', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734d646c-493a-4216-bcc4-534bbb850613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734d646c-493a-4216-bcc4-534bbb850613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27f0645-b2dc-4ea3-9e9b-062c675f1d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:44 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Volume 399d533b-b311-491f-b21f-951ea859f049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399d533b-b311-491f-b21f-951ea859f049', 'volume_size': 1} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1338729566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399d533b-b311-491f-b21f-951ea859f049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96f47185172c41ef89c79f508eadcd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:44Z,use_quota=True,user_id='9a0a61b3dfa2466a9d391e42eb3eb296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Creating volume 399d533b-b311-491f-b21f-951ea859f049 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:44 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:44 devstack sudo[110246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 1073741824 Jun 24 16:11:44 devstack sudo[110246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:45 devstack sudo[110246]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 1073741824" returned: 0 in 0.884s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:45 devstack sudo[110251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 Jun 24 16:11:45 devstack sudo[110251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:46 devstack sudo[110251]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049" returned: 0 in 0.689s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27f0645-b2dc-4ea3-9e9b-062c675f1d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399d533b-b311-491f-b21f-951ea859f049', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9086f3-403c-4800-ae36-686619318e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:46 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Volume volume-399d533b-b311-491f-b21f-951ea859f049 (399d533b-b311-491f-b21f-951ea859f049): created successfully Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9086f3-403c-4800-ae36-686619318e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Flow 'volume_create_manager' (1846723f-885d-470d-92d9-f1a96a4dfcb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7228138b-81b7-4520-b635-19eb3e7778f2 tempest-VolumesListTestJSON-1023106522 None] Created volume successfully. Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Flow 'volume_create_manager' (bbdd7e2d-091e-49b8-ad3c-13761037bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:46 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1250a2-aa97-4e7a-bf8c-d02e80c3bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1250a2-aa97-4e7a-bf8c-d02e80c3bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1292121372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9c9a38-e466-4442-a411-4986e52ec212,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96f47185172c41ef89c79f508eadcd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:47Z,use_quota=True,user_id='9a0a61b3dfa2466a9d391e42eb3eb296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f664ae3-4534-4244-be1d-7a997c739539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f664ae3-4534-4244-be1d-7a997c739539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b00926-5d11-4fea-ae62-6735f33fe954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b00926-5d11-4fea-ae62-6735f33fe954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9c9a38-e466-4442-a411-4986e52ec212', 'volume_name': 'volume-5e9c9a38-e466-4442-a411-4986e52ec212', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afac6054-5994-45df-9c61-09482f124ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afac6054-5994-45df-9c61-09482f124ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca82a63f-5029-4702-b8e4-5f9408848aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:47 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Volume 5e9c9a38-e466-4442-a411-4986e52ec212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9c9a38-e466-4442-a411-4986e52ec212', 'volume_size': 1} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1292121372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9c9a38-e466-4442-a411-4986e52ec212,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96f47185172c41ef89c79f508eadcd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:47Z,use_quota=True,user_id='9a0a61b3dfa2466a9d391e42eb3eb296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Creating volume 5e9c9a38-e466-4442-a411-4986e52ec212 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:47 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:47 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 1073741824 Jun 24 16:11:47 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:48 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 1073741824" returned: 0 in 0.992s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:48 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 Jun 24 16:11:48 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:48 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212" returned: 0 in 0.709s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca82a63f-5029-4702-b8e4-5f9408848aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9c9a38-e466-4442-a411-4986e52ec212', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98392aaa-550d-469b-baa8-112859959cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Volume volume-5e9c9a38-e466-4442-a411-4986e52ec212 (5e9c9a38-e466-4442-a411-4986e52ec212): created successfully Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98392aaa-550d-469b-baa8-112859959cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Flow 'volume_create_manager' (bbdd7e2d-091e-49b8-ad3c-13761037bda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:48 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ad33857e-6e9f-4458-aa45-a2a10088e4aa tempest-VolumesListTestJSON-1023106522 None] Created volume successfully. Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Flow 'volume_create_manager' (1dc2ad2d-cc15-4b1c-95b4-fc1d48e43bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed67f2e-903f-49be-82b5-545a231a3a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed67f2e-903f-49be-82b5-545a231a3a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-664939387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ceec15-680b-4248-a6f8-2a0a7b1e4763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96f47185172c41ef89c79f508eadcd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:50Z,use_quota=True,user_id='9a0a61b3dfa2466a9d391e42eb3eb296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00d8030-7e38-43d6-b3ed-8c74febf7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00d8030-7e38-43d6-b3ed-8c74febf7dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11100a5-2bc4-4c9d-93b9-6e08be592ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11100a5-2bc4-4c9d-93b9-6e08be592ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ceec15-680b-4248-a6f8-2a0a7b1e4763', 'volume_name': 'volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da000133-cd26-45f6-b889-d58331abda07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da000133-cd26-45f6-b889-d58331abda07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e76f07-45e2-4d72-92ae-822505f834b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:49 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Volume 14ceec15-680b-4248-a6f8-2a0a7b1e4763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763', 'volume_size': 1} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-664939387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ceec15-680b-4248-a6f8-2a0a7b1e4763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96f47185172c41ef89c79f508eadcd27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:50Z,use_quota=True,user_id='9a0a61b3dfa2466a9d391e42eb3eb296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Creating volume 14ceec15-680b-4248-a6f8-2a0a7b1e4763 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:49 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:49 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 1073741824 Jun 24 16:11:49 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (ef3b328f-04b2-479d-b33e-f595d08929b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be97ba5d-a517-4349-bc20-a36e2d701bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be97ba5d-a517-4349-bc20-a36e2d701bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1397289997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc28bf9f-ca64-4d2e-9f83-6af1257b0387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:50Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8c8a17-6168-4dc5-b4b9-00bc3025dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8c8a17-6168-4dc5-b4b9-00bc3025dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c05989-3672-4316-89af-cb6febe699a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c05989-3672-4316-89af-cb6febe699a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc28bf9f-ca64-4d2e-9f83-6af1257b0387', 'volume_name': 'volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8017e1-8c14-4434-8802-c283ff7f7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8017e1-8c14-4434-8802-c283ff7f7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb5bc2d-ec05-4c18-9a65-82cbfd050fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:50 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Volume fc28bf9f-ca64-4d2e-9f83-6af1257b0387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387', 'volume_size': 1} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:50 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 1073741824" returned: 0 in 0.952s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:50 devstack sudo[110269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 Jun 24 16:11:50 devstack sudo[110269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:51 devstack sudo[110269]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763" returned: 0 in 0.629s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1397289997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc28bf9f-ca64-4d2e-9f83-6af1257b0387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:11:50Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Creating volume fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:11:51 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e76f07-45e2-4d72-92ae-822505f834b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6c73ad-ce9f-4c67-a44e-e172d5e58f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:51 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 1073741824 Jun 24 16:11:51 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:51 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Volume volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 (14ceec15-680b-4248-a6f8-2a0a7b1e4763): created successfully Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6c73ad-ce9f-4c67-a44e-e172d5e58f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:51 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Flow 'volume_create_manager' (1dc2ad2d-cc15-4b1c-95b4-fc1d48e43bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:51 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-339a7fac-62c1-426f-abcd-cfafc3eba2b1 tempest-VolumesListTestJSON-1023106522 None] Created volume successfully. Jun 24 16:11:52 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 1073741824" returned: 0 in 0.874s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:52 devstack sudo[110278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 Jun 24 16:11:52 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:52 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" returned: 0 in 0.656s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb5bc2d-ec05-4c18-9a65-82cbfd050fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee17372-5481-458e-a924-f28d347e2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:11:53 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Volume volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 (fc28bf9f-ca64-4d2e-9f83-6af1257b0387): created successfully Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee17372-5481-458e-a924-f28d347e2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (ef3b328f-04b2-479d-b33e-f595d08929b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:11:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-267bf639-0652-4377-8a90-927190cc60a8 tempest-VolumesSnapshotTestJSON-837291870 None] Created volume successfully. Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "cinder-14ceec15-680b-4248-a6f8-2a0a7b1e4763-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-14ceec15-680b-4248-a6f8-2a0a7b1e4763-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "cinder-quobyte-14ceec15-680b-4248-a6f8-2a0a7b1e4763" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Creating offline snapshot 2084050c-e104-49e0-be8b-a16aa14f9561 of volume fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-quobyte-14ceec15-680b-4248-a6f8-2a0a7b1e4763" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef9e444-fefc-4d23-8dc1-54bb2ea06d7b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d011a796-1018-401e-92c4-7f2d11c7f7a2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:53 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 Jun 24 16:11:53 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:53 devstack sudo[110284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 Jun 24 16:11:53 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:54 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" returned: 0 in 0.762s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:54 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763" returned: 0 in 0.772s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:54 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 1G Jun 24 16:11:54 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:54 devstack sudo[110296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763 Jun 24 16:11:54 devstack sudo[110296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:55 devstack sudo[110296]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-14ceec15-680b-4248-a6f8-2a0a7b1e4763" returned: 0 in 0.657s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-quobyte-14ceec15-680b-4248-a6f8-2a0a7b1e4763" released by "delete_volume" :: held 1.477s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Created reservations ['1f261b1d-fcd9-41ea-92d7-7b95038ee7cb', '0bb48bc6-dcb1-4e15-82cb-6a1ba1e1649c', '749ae87f-05f8-49df-acfd-eca63829e366', '0d595691-1a97-4b85-964d-b3bd88b0128c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:55 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 1G" returned: 0 in 0.837s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:55 devstack sudo[110303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:55 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:55 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 Jun 24 16:11:55 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "cinder-5e9c9a38-e466-4442-a411-4986e52ec212-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-5e9c9a38-e466-4442-a411-4986e52ec212-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "cinder-quobyte-5e9c9a38-e466-4442-a411-4986e52ec212" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-quobyte-5e9c9a38-e466-4442-a411-4986e52ec212" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a569f4-1a3e-455c-b704-9787d25ec92b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:56 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.736s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:56 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Deleted volume successfully. Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-cb36809f-86ac-4db8-bef1-d3d7b25423b8 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-14ceec15-680b-4248-a6f8-2a0a7b1e4763-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:56 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561" returned: 0 in 0.763s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:56 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 is being set with open permissions: ugo+rw Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:56 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 Jun 24 16:11:56 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:56 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 Jun 24 16:11:56 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:56 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561" returned: 0 in 0.647s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:56 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info Jun 24 16:11:56 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:56 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212" returned: 0 in 0.794s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:56 devstack sudo[110322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212 Jun 24 16:11:56 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:57 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:57 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info is being set with open permissions: ugo+rw Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:57 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e9c9a38-e466-4442-a411-4986e52ec212" returned: 0 in 0.625s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:57 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info Jun 24 16:11:57 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-quobyte-5e9c9a38-e466-4442-a411-4986e52ec212" released by "delete_volume" :: held 1.465s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Created reservations ['bf9fbdf9-16da-48a6-9318-3e2e8873110b', '276ce97a-1638-44d8-929e-6763a256a564', '6f465ed1-1fb8-4197-b138-f71846f99be3', '50455682-9631-46f9-ac37-ef6656157442'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:57 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:57 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:58 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.info" returned: 0 in 0.636s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.422s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:58 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-fe0ed43b-f000-4f9c-8f6e-1b5e5381992b tempest-VolumesSnapshotTestJSON-837291870 None] Create snapshot completed successfully Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "cinder-399d533b-b311-491f-b21f-951ea859f049-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-399d533b-b311-491f-b21f-951ea859f049-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:58 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.661s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "cinder-quobyte-399d533b-b311-491f-b21f-951ea859f049" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:58 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Deleted volume successfully. Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-quobyte-399d533b-b311-491f-b21f-951ea859f049" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11626f43-dce0-4db9-80c2-00f66264e091 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-5e9c9a38-e466-4442-a411-4986e52ec212-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f98206-e680-4377-905a-3a8d7c63206b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:58 devstack sudo[110332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 Jun 24 16:11:58 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-2084050c-e104-49e0-be8b-a16aa14f9561-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:59 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-2084050c-e104-49e0-be8b-a16aa14f9561-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:59 devstack sudo[110337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049 Jun 24 16:11:59 devstack sudo[110337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-2084050c-e104-49e0-be8b-a16aa14f9561" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-2084050c-e104-49e0-be8b-a16aa14f9561" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Deleting offline snapshot 2084050c-e104-49e0-be8b-a16aa14f9561 of volume fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] snapshot_file for this snap is: volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0658b275-7680-4fc1-b6fc-553563b7d03e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:59 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 Jun 24 16:11:59 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:11:59 devstack sudo[110337]: pam_unix(sudo:session): session closed for user root Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-399d533b-b311-491f-b21f-951ea859f049" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-quobyte-399d533b-b311-491f-b21f-951ea859f049" released by "delete_volume" :: held 1.472s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Created reservations ['ced87f70-ffbd-41a7-9dd2-eb194fe36234', 'b9bd27ff-dacb-41b6-8175-c6b41edadb34', '84da99a3-8e21-45a7-a4db-57e70823c467', 'd01a0671-1bee-4065-b946-a2c2418dafb8'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:11:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:11:59 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:11:59 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:00 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561" returned: 0 in 0.788s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7dfd60-a57d-4dc3-9c36-992b76b21d7f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:00 devstack sudo[110381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 Jun 24 16:12:00 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:00 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.695s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:12:00 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Deleted volume successfully. Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f9d3d82e-879a-4b94-a55c-c06f8b908185 tempest-VolumesListTestJSON-1023106522 None] Lock "cinder-399d533b-b311-491f-b21f-951ea859f049-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:00 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:00 devstack sudo[110389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 Jun 24 16:12:00 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:01 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561" returned: 0 in 0.795s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:01 devstack sudo[110394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561 Jun 24 16:12:01 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:02 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387.2084050c-e104-49e0-be8b-a16aa14f9561" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:02 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=134,cinder:INSERT=41,cinder:DELETE=10,cinder:SELECT=106 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:12:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-2084050c-e104-49e0-be8b-a16aa14f9561" released by "_delete_snapshot" :: held 3.162s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" released by "delete_snapshot" :: held 3.184s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:02 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['53a97583-d603-4401-a50c-574be1bbb682', '5f9d76c8-2507-40d2-9826-5e9bccf4c7f9', '9f331c26-b00e-4896-9874-092e3dd1b24e', '31a1740e-d119-4f9d-8c58-567416bccc87'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Delete snapshot completed successfully. Jun 24 16:12:02 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-dbaf21ec-b114-4cee-9767-f66fef695264 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-2084050c-e104-49e0-be8b-a16aa14f9561-delete_snapshot" released by "delete_snapshot" :: held 3.369s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=106,cinder:UPDATE=133,cinder:DELETE=14,cinder:INSERT=35 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (e75196c7-7785-4851-8609-e57f87f5ea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d32a769-2654-4346-a030-ba46848936b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d32a769-2654-4346-a030-ba46848936b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1895023772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed1650-cdc9-495f-a05f-4ddd619333e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:04Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5295ffb1-5577-4e56-a58c-2c089ae061ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5295ffb1-5577-4e56-a58c-2c089ae061ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efc984f-aea4-4ff8-8f49-b2401f3e79a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efc984f-aea4-4ff8-8f49-b2401f3e79a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daed1650-cdc9-495f-a05f-4ddd619333e0', 'volume_name': 'volume-daed1650-cdc9-495f-a05f-4ddd619333e0', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaf6fbf-1d4a-4adc-868d-3eca1c0b8f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaf6fbf-1d4a-4adc-868d-3eca1c0b8f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df4159b-9a4e-4844-93c8-02e4e96f21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Volume daed1650-cdc9-495f-a05f-4ddd619333e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daed1650-cdc9-495f-a05f-4ddd619333e0', 'volume_size': 1} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1895023772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed1650-cdc9-495f-a05f-4ddd619333e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:04Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Creating volume daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:12:04 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:04 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 1073741824 Jun 24 16:12:04 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:04 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 1073741824" returned: 0 in 0.870s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:05 devstack sudo[110406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:05 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:05 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df4159b-9a4e-4844-93c8-02e4e96f21ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daed1650-cdc9-495f-a05f-4ddd619333e0', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0708028b-ffbb-4a8e-bf8f-51c8078101c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Volume volume-daed1650-cdc9-495f-a05f-4ddd619333e0 (daed1650-cdc9-495f-a05f-4ddd619333e0): created successfully Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0708028b-ffbb-4a8e-bf8f-51c8078101c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (e75196c7-7785-4851-8609-e57f87f5ea71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-436c84ce-74af-4608-8789-f2db904b64c0 tempest-VolumesSnapshotTestJSON-837291870 None] Created volume successfully. Jun 24 16:12:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:06 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Creating offline snapshot 37110338-235e-4dd0-ba07-e2b493aa021b of volume daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:12:06 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfce4cc-b667-4e49-a1e6-218c9147f697]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:06 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:06 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:07 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.882s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:07 devstack sudo[110416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b 1G Jun 24 16:12:07 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:08 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b 1G" returned: 0 in 0.878s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daed1650-cdc9-495f-a05f-4ddd619333e0 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:08 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daed1650-cdc9-495f-a05f-4ddd619333e0 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b Jun 24 16:12:08 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:08 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daed1650-cdc9-495f-a05f-4ddd619333e0 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b" returned: 0 in 0.723s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:08 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b is being set with open permissions: ugo+rw Jun 24 16:12:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:08 devstack sudo[110427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b Jun 24 16:12:08 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:09 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b" returned: 0 in 0.676s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:09 devstack sudo[110430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info Jun 24 16:12:09 devstack sudo[110430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:10 devstack sudo[110430]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info" returned: 0 in 0.679s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:10 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info is being set with open permissions: ugo+rw Jun 24 16:12:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:10 devstack sudo[110433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info Jun 24 16:12:10 devstack sudo[110433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:10 devstack sudo[110433]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.info" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.586s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:10 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-44611a16-0bdf-4f35-a67a-132fd3dce2e0 tempest-VolumesSnapshotTestJSON-837291870 None] Create snapshot completed successfully Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (91d42949-6d25-45e3-bdce-21db32c6425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ec1b13-1358-4596-90ed-e4c92a388a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ec1b13-1358-4596-90ed-e4c92a388a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1530784978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74f487f-6259-419f-afd9-2136e678fb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=37110338-235e-4dd0-ba07-e2b493aa021b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:12Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7da643-9a00-482b-8fe7-5d66d9abf776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7da643-9a00-482b-8fe7-5d66d9abf776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41643c8-3c7e-4519-9166-35c0f8561fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41643c8-3c7e-4519-9166-35c0f8561fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c74f487f-6259-419f-afd9-2136e678fb43', 'volume_name': 'volume-c74f487f-6259-419f-afd9-2136e678fb43', 'volume_size': 2, 'snapshot_id': '37110338-235e-4dd0-ba07-e2b493aa021b'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9328fb27-8102-4250-8307-70c0505f52a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9328fb27-8102-4250-8307-70c0505f52a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8959b35-114a-455b-b5ae-787a14617424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Volume c74f487f-6259-419f-afd9-2136e678fb43: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c74f487f-6259-419f-afd9-2136e678fb43', 'volume_size': 2, 'snapshot_id': '37110338-235e-4dd0-ba07-e2b493aa021b'} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-37110338-235e-4dd0-ba07-e2b493aa021b-c74f487f-6259-419f-afd9-2136e678fb43" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-37110338-235e-4dd0-ba07-e2b493aa021b-c74f487f-6259-419f-afd9-2136e678fb43" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Creating volume c74f487f-6259-419f-afd9-2136e678fb43 from snapshot 37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-c74f487f-6259-419f-afd9-2136e678fb43" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-c74f487f-6259-419f-afd9-2136e678fb43" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] snapshot: 37110338-235e-4dd0-ba07-e2b493aa021b, volume: c74f487f-6259-419f-afd9-2136e678fb43, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0933fb4-e3ea-4a43-a7fb-dc5714301e53]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:12 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b Jun 24 16:12:12 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:13 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b" returned: 0 in 0.848s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daed1650-cdc9-495f-a05f-4ddd619333e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc0082-00a8-4851-9e7a-951ebff11a3e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:13 devstack sudo[110441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:13 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:13 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.769s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:12:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:13 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 Jun 24 16:12:13 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:19 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43" returned: 0 in 5.383s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdcc962-ae87-4d24-a27d-41a50e5b5fb0]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:19 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:19 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:20 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.959s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:12:20 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Converted 1024.00 MB image at 190.19 MB/s Jun 24 16:12:20 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 is being set with open permissions: ugo+rw Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:20 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 Jun 24 16:12:20 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:20 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-c74f487f-6259-419f-afd9-2136e678fb43" released by "_copy_volume_from_snapshot" :: held 8.740s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-37110338-235e-4dd0-ba07-e2b493aa021b-c74f487f-6259-419f-afd9-2136e678fb43" released by "_create_volume_from_snapshot" :: held 8.772s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.788s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8959b35-114a-455b-b5ae-787a14617424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74f487f-6259-419f-afd9-2136e678fb43', 'volume_size': 2, 'snapshot_id': '37110338-235e-4dd0-ba07-e2b493aa021b'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b758a26-53ed-4939-b3fd-845931a8f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:21 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Volume volume-c74f487f-6259-419f-afd9-2136e678fb43 (c74f487f-6259-419f-afd9-2136e678fb43): created successfully Jun 24 16:12:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b758a26-53ed-4939-b3fd-845931a8f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (91d42949-6d25-45e3-bdce-21db32c6425e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f3e7c659-59ed-4d28-917a-fb6966721241 tempest-VolumesSnapshotTestJSON-837291870 None] Created volume successfully. Jun 24 16:12:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-c74f487f-6259-419f-afd9-2136e678fb43-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-c74f487f-6259-419f-afd9-2136e678fb43-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-c74f487f-6259-419f-afd9-2136e678fb43" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-c74f487f-6259-419f-afd9-2136e678fb43" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:22 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d12d647-2500-497f-8527-aaca538c77da]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:22 devstack sudo[110467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 Jun 24 16:12:22 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:23 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43" returned: 0 in 0.898s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:23 devstack sudo[110472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43 Jun 24 16:12:23 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:23 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c74f487f-6259-419f-afd9-2136e678fb43" returned: 0 in 0.709s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-c74f487f-6259-419f-afd9-2136e678fb43" released by "delete_volume" :: held 1.665s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:23 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['2f5df76d-9204-4026-bc8a-fe820b2df62f', 'd89d9475-dc1c-4d7e-9374-d34ed37d6afb', 'ec30f1e5-b203-4d8a-8d5f-4f06cbc46948', '086f0fba-f6f1-4f88-a2ad-907a302cb40b'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:24 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:12:24 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-37110338-235e-4dd0-ba07-e2b493aa021b-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-37110338-235e-4dd0-ba07-e2b493aa021b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-daed1650-cdc9-495f-a05f-4ddd619333e0" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-daed1650-cdc9-495f-a05f-4ddd619333e0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-37110338-235e-4dd0-ba07-e2b493aa021b" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-37110338-235e-4dd0-ba07-e2b493aa021b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Deleting offline snapshot 37110338-235e-4dd0-ba07-e2b493aa021b of volume daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] snapshot_file for this snap is: volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88359b-ea5d-4cac-a42e-52cc30037f6c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:24 devstack sudo[110478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b Jun 24 16:12:24 devstack sudo[110478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:24 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:12:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Deleted volume successfully. Jun 24 16:12:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7deac4a7-4816-4a07-85db-b53faaabae1c tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-c74f487f-6259-419f-afd9-2136e678fb43-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:25 devstack sudo[110478]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b" returned: 0 in 0.899s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daed1650-cdc9-495f-a05f-4ddd619333e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:12:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3140d-f42d-48e6-b7db-6afe8e4c669f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:25 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:25 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Flow 'volume_create_manager' (131bf830-dd68-42db-baf1-cdb89f7d3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c98868-2195-4985-95b9-d861429474eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c98868-2195-4985-95b9-d861429474eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-891805045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fced2728-2c0b-4342-973e-760676147dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3752e492394117b7caace68aa9bec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:26Z,use_quota=True,user_id='5f2d6bdd65f54d3f8f31c1bcf53c5279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e392c6c5-f687-43d0-9b32-3b8540484b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e392c6c5-f687-43d0-9b32-3b8540484b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e574d-d1ff-4ae2-8e25-6126b5da3b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e574d-d1ff-4ae2-8e25-6126b5da3b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fced2728-2c0b-4342-973e-760676147dab', 'volume_name': 'volume-fced2728-2c0b-4342-973e-760676147dab', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de093c0a-0813-4c86-b776-fa71a9bb8c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de093c0a-0813-4c86-b776-fa71a9bb8c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16309d27-2a3d-4c90-bc31-b1f4e23cb5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Volume fced2728-2c0b-4342-973e-760676147dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fced2728-2c0b-4342-973e-760676147dab', 'volume_size': 1} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-891805045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fced2728-2c0b-4342-973e-760676147dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3752e492394117b7caace68aa9bec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:26Z,use_quota=True,user_id='5f2d6bdd65f54d3f8f31c1bcf53c5279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Creating volume fced2728-2c0b-4342-973e-760676147dab {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:26 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:12:26 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:26 devstack sudo[110490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab 1073741824 Jun 24 16:12:26 devstack sudo[110490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:26 devstack sudo[110491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b Jun 24 16:12:26 devstack sudo[110491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Flow 'volume_create_manager' (b982b05f-2b1b-4d6b-b0d5-872d4fa6104e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d0780b-c925-4fd1-8ee0-24c8de3c9311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d0780b-c925-4fd1-8ee0-24c8de3c9311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-418479327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9087dff8-a176-4ec5-85cf-7641940b1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3752e492394117b7caace68aa9bec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:27Z,use_quota=True,user_id='5f2d6bdd65f54d3f8f31c1bcf53c5279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b44a315-931a-46df-bdb8-28ef899a7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b44a315-931a-46df-bdb8-28ef899a7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bafc37-eb99-4bd7-93ac-a8c924922708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bafc37-eb99-4bd7-93ac-a8c924922708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9087dff8-a176-4ec5-85cf-7641940b1440', 'volume_name': 'volume-9087dff8-a176-4ec5-85cf-7641940b1440', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7950a3-7694-44c1-8871-23327c217483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7950a3-7694-44c1-8871-23327c217483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a8e4b0-2c2d-4777-8057-a2bcc201767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:26 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Volume 9087dff8-a176-4ec5-85cf-7641940b1440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9087dff8-a176-4ec5-85cf-7641940b1440', 'volume_size': 1} Jun 24 16:12:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:27 devstack sudo[110491]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b" returned: 0 in 0.877s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:27 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b Jun 24 16:12:27 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:27 devstack sudo[110490]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab 1073741824" returned: 0 in 1.012s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:27 devstack sudo[110504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab Jun 24 16:12:27 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:27 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0.37110338-235e-4dd0-ba07-e2b493aa021b" returned: 0 in 0.704s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-37110338-235e-4dd0-ba07-e2b493aa021b" released by "_delete_snapshot" :: held 3.420s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-daed1650-cdc9-495f-a05f-4ddd619333e0" released by "delete_snapshot" :: held 3.446s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['c62bbeb6-caae-4f8f-b437-43a36952bbc4', 'a32b4aad-0dd1-47a6-9e88-5d59880b4a21', '3d201dca-fc52-4055-bc3b-9040da9b582b', 'f93d201e-3d59-447f-9db2-962e65e91517'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:28 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab" returned: 0 in 0.717s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-418479327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9087dff8-a176-4ec5-85cf-7641940b1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae3752e492394117b7caace68aa9bec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:27Z,use_quota=True,user_id='5f2d6bdd65f54d3f8f31c1bcf53c5279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Creating volume 9087dff8-a176-4ec5-85cf-7641940b1440 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:12:28 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16309d27-2a3d-4c90-bc31-b1f4e23cb5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fced2728-2c0b-4342-973e-760676147dab', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:28 devstack sudo[110508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 1073741824 Jun 24 16:12:28 devstack sudo[110508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac01fc2-dbd1-4f78-965e-78c292fe8689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Delete snapshot completed successfully. Jun 24 16:12:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Volume volume-fced2728-2c0b-4342-973e-760676147dab (fced2728-2c0b-4342-973e-760676147dab): created successfully Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac01fc2-dbd1-4f78-965e-78c292fe8689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Flow 'volume_create_manager' (131bf830-dd68-42db-baf1-cdb89f7d3c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5cbd809b-e5ee-48bb-ac94-b88efe0d3442 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-37110338-235e-4dd0-ba07-e2b493aa021b-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a1938e5c-61fa-47c8-aa1f-50eaff1f0c3d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Created volume successfully. Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-daed1650-cdc9-495f-a05f-4ddd619333e0-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-daed1650-cdc9-495f-a05f-4ddd619333e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-daed1650-cdc9-495f-a05f-4ddd619333e0" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-daed1650-cdc9-495f-a05f-4ddd619333e0" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c1847-581c-4a02-8ddd-ba4726ee6b3e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:29 devstack sudo[110508]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 1073741824" returned: 0 in 0.930s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:29 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:29 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:29 devstack sudo[110516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 Jun 24 16:12:29 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:29 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440" returned: 0 in 0.696s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a8e4b0-2c2d-4777-8057-a2bcc201767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9087dff8-a176-4ec5-85cf-7641940b1440', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c145ffad-f80d-4e82-b6ce-5de8edaa2539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:29 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Volume volume-9087dff8-a176-4ec5-85cf-7641940b1440 (9087dff8-a176-4ec5-85cf-7641940b1440): created successfully Jun 24 16:12:29 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c145ffad-f80d-4e82-b6ce-5de8edaa2539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Flow 'volume_create_manager' (b982b05f-2b1b-4d6b-b0d5-872d4fa6104e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.883s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:29 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-239e2f92-f165-411c-b796-c17f8707126a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Created volume successfully. Jun 24 16:12:29 devstack sudo[110525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0 Jun 24 16:12:29 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:30 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-daed1650-cdc9-495f-a05f-4ddd619333e0" returned: 0 in 0.718s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-daed1650-cdc9-495f-a05f-4ddd619333e0" released by "delete_volume" :: held 1.683s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['be21150d-1569-4493-9e47-94f06aa72095', '062084b8-0c9f-4d00-9402-f4d521bfb9c1', '8a1b500b-3608-4c12-9f54-e7b652db49df', 'ebc6724e-9583-4d0b-bbd5-3929a6fcda57'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:30 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:12:30 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:31 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.686s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:12:31 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Deleted volume successfully. Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6e8fd203-2ef8-4644-b569-397cdea8dff6 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-daed1650-cdc9-495f-a05f-4ddd619333e0-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (4365cd34-dc97-4898-8ac1-fbed2c7b990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eac54c6-fd54-4b15-86c0-ad22c89f921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eac54c6-fd54-4b15-86c0-ad22c89f921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-737352416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce1c644-2d35-4691-abc2-f77bffd805c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:32Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e64869e-0ab7-4c41-ab6d-7482974e8bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e64869e-0ab7-4c41-ab6d-7482974e8bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33dcd54a-724f-4d6c-9f28-f87350e2b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33dcd54a-724f-4d6c-9f28-f87350e2b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce1c644-2d35-4691-abc2-f77bffd805c7', 'volume_name': 'volume-9ce1c644-2d35-4691-abc2-f77bffd805c7', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a5feda-7c4e-4b6d-adf2-e2a3b88c2d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a5feda-7c4e-4b6d-adf2-e2a3b88c2d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26da879-2e28-48ae-8426-120fdbbb645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Volume 9ce1c644-2d35-4691-abc2-f77bffd805c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce1c644-2d35-4691-abc2-f77bffd805c7', 'volume_size': 1} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-737352416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce1c644-2d35-4691-abc2-f77bffd805c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:32Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Creating volume 9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:12:31 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:12:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:31 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 1073741824 Jun 24 16:12:31 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:32 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 1073741824" returned: 0 in 0.838s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:32 devstack sudo[110543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:32 devstack sudo[110543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:33 devstack sudo[110543]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 0.652s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26da879-2e28-48ae-8426-120fdbbb645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce1c644-2d35-4691-abc2-f77bffd805c7', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b272b66e-812e-44c4-b06c-11f92d90b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Volume volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 (9ce1c644-2d35-4691-abc2-f77bffd805c7): created successfully Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b272b66e-812e-44c4-b06c-11f92d90b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (4365cd34-dc97-4898-8ac1-fbed2c7b990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8f367747-81e7-4390-b2d2-6701ecf1c266 tempest-VolumesSnapshotTestJSON-837291870 None] Created volume successfully. Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Creating offline snapshot bf036f54-bbd1-426c-96e5-b3ddafee1e20 of volume 9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[89221b2a-ea20-49d8-adc5-9d4c1724315b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:34 devstack sudo[110547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:34 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:34 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 0.769s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:34 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 1G Jun 24 16:12:34 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:35 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 1G" returned: 0 in 0.910s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:35 devstack sudo[110559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 Jun 24 16:12:35 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:36 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20" returned: 0 in 0.743s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:36 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 is being set with open permissions: ugo+rw Jun 24 16:12:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:36 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 Jun 24 16:12:36 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:37 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20" returned: 0 in 0.737s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:37 devstack sudo[110578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info Jun 24 16:12:37 devstack sudo[110578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:37 devstack sudo[110578]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info" returned: 0 in 0.667s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:37 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info is being set with open permissions: ugo+rw Jun 24 16:12:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:37 devstack sudo[110586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info Jun 24 16:12:37 devstack sudo[110586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:38 devstack sudo[110586]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.info" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.583s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:38 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d49418f0-9f38-4f94-9988-e99ac7a26953 tempest-VolumesSnapshotTestJSON-837291870 None] Create snapshot completed successfully Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:39 devstack sudo[110589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:12:39 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (b3c32ee4-4671-4f66-a2c3-28ebc34e538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588f91e9-1c5e-423c-8150-76dc9904a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588f91e9-1c5e-423c-8150-76dc9904a67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-848961244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698992a7-24b8-4e02-b1f6-d2a258048f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7a8def0824c9fbd09a4b905222417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf036f54-bbd1-426c-96e5-b3ddafee1e20,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:12:40Z,use_quota=True,user_id='ce1db68a58ed497890f56f3772d034d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057d29bc-ba3f-4b83-85a5-338c33a27c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057d29bc-ba3f-4b83-85a5-338c33a27c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd776d5d-345a-4c35-8a69-fff40397481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd776d5d-345a-4c35-8a69-fff40397481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '698992a7-24b8-4e02-b1f6-d2a258048f7f', 'volume_name': 'volume-698992a7-24b8-4e02-b1f6-d2a258048f7f', 'volume_size': 1, 'snapshot_id': 'bf036f54-bbd1-426c-96e5-b3ddafee1e20'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3d9c38-ac99-49d2-a92b-520d6bc76aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3d9c38-ac99-49d2-a92b-520d6bc76aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85a6df0-36e5-4002-9663-514d9e15cbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:39 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Volume 698992a7-24b8-4e02-b1f6-d2a258048f7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-698992a7-24b8-4e02-b1f6-d2a258048f7f', 'volume_size': 1, 'snapshot_id': 'bf036f54-bbd1-426c-96e5-b3ddafee1e20'} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-bf036f54-bbd1-426c-96e5-b3ddafee1e20-698992a7-24b8-4e02-b1f6-d2a258048f7f" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-bf036f54-bbd1-426c-96e5-b3ddafee1e20-698992a7-24b8-4e02-b1f6-d2a258048f7f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Creating volume 698992a7-24b8-4e02-b1f6-d2a258048f7f from snapshot bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-698992a7-24b8-4e02-b1f6-d2a258048f7f" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-698992a7-24b8-4e02-b1f6-d2a258048f7f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] snapshot: bf036f54-bbd1-426c-96e5-b3ddafee1e20, volume: 698992a7-24b8-4e02-b1f6-d2a258048f7f, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10babe4-2b0e-403f-a508-da8c4e9c7334]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:39 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.684s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:12:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:12:40 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 Jun 24 16:12:40 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:40 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20" returned: 0 in 0.793s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce1c644-2d35-4691-abc2-f77bffd805c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:12:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:12:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:12:40 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8841a04-91b3-46eb-a366-c92b2ea65f4a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:40 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:40 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:41 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 0.730s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:41 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:12:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:41 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f Jun 24 16:12:41 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:48 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f" returned: 0 in 6.591s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[151ba425-ea9c-461c-88d1-33411a8c05c8]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:48 devstack sudo[110704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:48 devstack sudo[110704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:49 devstack sudo[110704]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 1.066s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:12:49 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Converted 1024.00 MB image at 155.33 MB/s Jun 24 16:12:49 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f is being set with open permissions: ugo+rw Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:49 devstack sudo[110711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f Jun 24 16:12:49 devstack sudo[110711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:49 devstack sudo[110711]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-698992a7-24b8-4e02-b1f6-d2a258048f7f" released by "_copy_volume_from_snapshot" :: held 9.940s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-bf036f54-bbd1-426c-96e5-b3ddafee1e20-698992a7-24b8-4e02-b1f6-d2a258048f7f" released by "_create_volume_from_snapshot" :: held 9.970s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.987s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85a6df0-36e5-4002-9663-514d9e15cbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698992a7-24b8-4e02-b1f6-d2a258048f7f', 'volume_size': 1, 'snapshot_id': 'bf036f54-bbd1-426c-96e5-b3ddafee1e20'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6562af2b-5c17-4aaf-97a4-177a6479e940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:12:49 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Volume volume-698992a7-24b8-4e02-b1f6-d2a258048f7f (698992a7-24b8-4e02-b1f6-d2a258048f7f): created successfully Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6562af2b-5c17-4aaf-97a4-177a6479e940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:12:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Flow 'volume_create_manager' (b3c32ee4-4671-4f66-a2c3-28ebc34e538c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:12:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e0fc4f77-f64a-44bb-869a-5dedecf00d9a tempest-VolumesSnapshotTestJSON-837291870 None] Created volume successfully. Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-698992a7-24b8-4e02-b1f6-d2a258048f7f-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-698992a7-24b8-4e02-b1f6-d2a258048f7f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-698992a7-24b8-4e02-b1f6-d2a258048f7f" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-698992a7-24b8-4e02-b1f6-d2a258048f7f" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069fc24-30b8-417c-89f9-87f87383722b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:50 devstack sudo[110714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f Jun 24 16:12:50 devstack sudo[110714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:50 devstack sudo[110714]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f" returned: 0 in 0.759s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:50 devstack sudo[110719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f Jun 24 16:12:50 devstack sudo[110719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:51 devstack sudo[110719]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-698992a7-24b8-4e02-b1f6-d2a258048f7f" returned: 0 in 0.647s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-698992a7-24b8-4e02-b1f6-d2a258048f7f" released by "delete_volume" :: held 1.469s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['ea194830-b5af-4649-bdc3-25a5b2d2c359', 'bdcb939a-c82b-4dab-a7be-d7ba75a7f373', '6bca62df-9ea1-4181-adaa-3ea75e30f7e2', '1c0f0e0a-7f95-47bb-b193-3b6713c8f279'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:51 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:12:51 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:52 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.620s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:12:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Deleted volume successfully. Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-31e969de-5b34-47c7-83d1-92e7c9ae77aa tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-698992a7-24b8-4e02-b1f6-d2a258048f7f-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-bf036f54-bbd1-426c-96e5-b3ddafee1e20-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-bf036f54-bbd1-426c-96e5-b3ddafee1e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-9ce1c644-2d35-4691-abc2-f77bffd805c7" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-9ce1c644-2d35-4691-abc2-f77bffd805c7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-bf036f54-bbd1-426c-96e5-b3ddafee1e20" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-bf036f54-bbd1-426c-96e5-b3ddafee1e20" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Deleting offline snapshot bf036f54-bbd1-426c-96e5-b3ddafee1e20 of volume 9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] snapshot_file for this snap is: volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba78e2-68c9-4854-96ea-108c98ca6124]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:52 devstack sudo[110725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 Jun 24 16:12:52 devstack sudo[110725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:53 devstack sudo[110725]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce1c644-2d35-4691-abc2-f77bffd805c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:12:53 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9179205-71c2-471a-b839-5f700d932bd0]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:53 devstack sudo[110730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:53 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:54 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 0.766s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:54 devstack sudo[110736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 Jun 24 16:12:54 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:54 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20" returned: 0 in 0.732s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:54 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20 Jun 24 16:12:54 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:55 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7.bf036f54-bbd1-426c-96e5-b3ddafee1e20" returned: 0 in 0.644s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-bf036f54-bbd1-426c-96e5-b3ddafee1e20" released by "_delete_snapshot" :: held 3.018s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-9ce1c644-2d35-4691-abc2-f77bffd805c7" released by "delete_snapshot" :: held 3.041s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:55 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['f350d6fa-e244-43a2-84fc-c67a41ab5a87', '76023bed-88dc-4c43-8982-7f202ef95eb5', 'ecca79f5-3170-41c1-9ea5-bfb408885276', '9d8f1d44-1d69-4100-849a-38757f8609ac'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Delete snapshot completed successfully. Jun 24 16:12:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-58b27932-2dfb-401b-bf18-7ff138f3955a tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-bf036f54-bbd1-426c-96e5-b3ddafee1e20-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-9ce1c644-2d35-4691-abc2-f77bffd805c7-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-9ce1c644-2d35-4691-abc2-f77bffd805c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-9ce1c644-2d35-4691-abc2-f77bffd805c7" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-9ce1c644-2d35-4691-abc2-f77bffd805c7" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:56 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f1943d-2c85-47e8-887d-33bec5849d44]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:56 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:56 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:57 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:57 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7 Jun 24 16:12:57 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:58 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9ce1c644-2d35-4691-abc2-f77bffd805c7" returned: 0 in 0.661s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-9ce1c644-2d35-4691-abc2-f77bffd805c7" released by "delete_volume" :: held 1.473s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['f8f87363-9f65-4833-9cd6-5e9fa883f4bb', '510c8fe8-abf3-4a27-9834-1972b11f03cf', 'a60eab24-e2d1-4ef1-a6a5-d9ffe1d95f07', '9f337625-d1d3-4de0-8923-632bb310b9b5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:12:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:58 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:12:58 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-fc28bf9f-ca64-4d2e-9f83-6af1257b0387-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-fc28bf9f-ca64-4d2e-9f83-6af1257b0387-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:59 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:12:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Deleted volume successfully. Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "cinder-quobyte-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ca514cf2-485e-4c1b-ba27-95c1bc9a865f tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-9ce1c644-2d35-4691-abc2-f77bffd805c7-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[156f6c25-c43b-4f85-b3fc-2872a45aeecd]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:59 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 Jun 24 16:12:59 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:12:59 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" returned: 0 in 0.738s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:12:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:12:59 devstack sudo[110785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387 Jun 24 16:12:59 devstack sudo[110785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:00 devstack sudo[110785]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-quobyte-fc28bf9f-ca64-4d2e-9f83-6af1257b0387" released by "delete_volume" :: held 1.440s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Created reservations ['cf90cc3a-340f-4d4b-8ba8-e2ff37225f0d', '97581451-946f-4569-8084-2cca0e31a97a', 'b5cc19d2-ab82-49e0-8bac-94b1013c2766', '27ffdf8b-2c9e-4d44-a469-40d10d3e5445'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:00 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:13:00 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:01 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.667s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:01 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:13:01 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Deleted volume successfully. Jun 24 16:13:01 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-964458bc-cca3-41d2-b300-04961aa718c0 tempest-VolumesSnapshotTestJSON-837291870 None] Lock "cinder-fc28bf9f-ca64-4d2e-9f83-6af1257b0387-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=62,cinder:INSERT=18,cinder:UPDATE=75,cinder:DELETE=8 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=71,cinder:INSERT=17,cinder:SELECT=54,cinder:DELETE=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Flow 'volume_create_manager' (11fdcc2d-992a-4e7d-85fd-3e5165fef9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644e666a-f3c7-4cfe-b5de-8f30574e7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644e666a-f3c7-4cfe-b5de-8f30574e7af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-350835703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b9607-e762-4f8e-8819-e142173843e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da61e5932b44522bf3b97ac5aa1f723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:13:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:13:07Z,use_quota=True,user_id='37ee89c6344a4804a85d443f39d891c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e78dc57-0bb1-4892-be9e-5ebe6ecbafe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e78dc57-0bb1-4892-be9e-5ebe6ecbafe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4898b1-2f38-4551-ae90-9eb40bc111c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4898b1-2f38-4551-ae90-9eb40bc111c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97b9607-e762-4f8e-8819-e142173843e6', 'volume_name': 'volume-d97b9607-e762-4f8e-8819-e142173843e6', 'volume_size': 2}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a300c51-08d5-499e-9fe3-37c0064d0ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a300c51-08d5-499e-9fe3-37c0064d0ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3031e7f8-b065-45bc-a71b-ce33167e3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:13:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Volume d97b9607-e762-4f8e-8819-e142173843e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97b9607-e762-4f8e-8819-e142173843e6', 'volume_size': 2} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-350835703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b9607-e762-4f8e-8819-e142173843e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da61e5932b44522bf3b97ac5aa1f723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:13:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:13:07Z,use_quota=True,user_id='37ee89c6344a4804a85d443f39d891c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Creating volume d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:13:07 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:13:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 2147483648 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:07 devstack sudo[110843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 2147483648 Jun 24 16:13:07 devstack sudo[110843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:08 devstack sudo[110843]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 2147483648" returned: 0 in 0.878s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:08 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 Jun 24 16:13:08 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:08 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6" returned: 0 in 0.638s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3031e7f8-b065-45bc-a71b-ce33167e3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97b9607-e762-4f8e-8819-e142173843e6', 'volume_size': 2}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d17ac5-ee36-4e14-8807-7c03509d158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:13:08 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Volume volume-d97b9607-e762-4f8e-8819-e142173843e6 (d97b9607-e762-4f8e-8819-e142173843e6): created successfully Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d17ac5-ee36-4e14-8807-7c03509d158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:13:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Flow 'volume_create_manager' (11fdcc2d-992a-4e7d-85fd-3e5165fef9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:13:08 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-24ad4608-e34a-40f3-99f0-e48c15d8493f tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Created volume successfully. Jun 24 16:13:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Creating offline snapshot c18dfd8f-80ff-461f-b64f-5489524b86e7 of volume d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:13:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b8c3f1-e7bd-4d13-9d79-7e6fcd02d258]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:09 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 Jun 24 16:13:09 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:10 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6" returned: 0 in 0.751s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 2G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:10 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 2G Jun 24 16:13:10 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:11 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 2G" returned: 0 in 0.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97b9607-e762-4f8e-8819-e142173843e6 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:11 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97b9607-e762-4f8e-8819-e142173843e6 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 Jun 24 16:13:11 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:11 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97b9607-e762-4f8e-8819-e142173843e6 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7" returned: 0 in 0.680s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:11 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 is being set with open permissions: ugo+rw Jun 24 16:13:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:11 devstack sudo[110874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 Jun 24 16:13:11 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:12 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7" returned: 0 in 0.624s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:12 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info Jun 24 16:13:12 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:13 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info" returned: 0 in 0.636s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:13 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info is being set with open permissions: ugo+rw Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:13 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info Jun 24 16:13:13 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:13 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.info" returned: 0 in 0.623s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.948s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c668e95a-6b08-43d9-86f9-1aceca3ca380]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4a79681d-9888-4d62-b6bd-feabc9dc67ad tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Create snapshot completed successfully Jun 24 16:13:13 devstack sudo[110892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab Jun 24 16:13:13 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:14 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab" returned: 0 in 0.751s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-fced2728-2c0b-4342-973e-760676147dab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c3215ae-9124-4745-9a37-7f3c444994e3', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:13:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-73a79dc9-0a05-4e71-a73a-c298de3ee40f req-ea6031f7-83bb-4e58-bb35-c2698eba255a tempest-TestServerVolumeAttachmentScenario-2012141750 None] attachment_update completed successfully. Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "cinder-c18dfd8f-80ff-461f-b64f-5489524b86e7-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-c18dfd8f-80ff-461f-b64f-5489524b86e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "cinder-quobyte-d97b9607-e762-4f8e-8819-e142173843e6" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-quobyte-d97b9607-e762-4f8e-8819-e142173843e6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "cinder-quobyte-c18dfd8f-80ff-461f-b64f-5489524b86e7" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-quobyte-c18dfd8f-80ff-461f-b64f-5489524b86e7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Deleting offline snapshot c18dfd8f-80ff-461f-b64f-5489524b86e7 of volume d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] snapshot_file for this snap is: volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a780143c-504f-4b80-84f5-7bd673d0e4b8]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:14 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 Jun 24 16:13:14 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:15 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7" returned: 0 in 0.746s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:15 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d97b9607-e762-4f8e-8819-e142173843e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:13:15 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff82200-8d37-4188-a390-3ccdc8c8e4b9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:15 devstack sudo[111287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 Jun 24 16:13:15 devstack sudo[111287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:16 devstack sudo[111287]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6" returned: 0 in 0.725s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:16 devstack sudo[111293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 Jun 24 16:13:16 devstack sudo[111293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:17 devstack sudo[111293]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7" returned: 0 in 0.719s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:17 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7 Jun 24 16:13:17 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:17 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6.c18dfd8f-80ff-461f-b64f-5489524b86e7" returned: 0 in 0.643s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-quobyte-c18dfd8f-80ff-461f-b64f-5489524b86e7" released by "_delete_snapshot" :: held 2.932s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-quobyte-d97b9607-e762-4f8e-8819-e142173843e6" released by "delete_snapshot" :: held 2.961s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Created reservations ['15956573-75de-4e06-9eb8-6977905a5340', '524e2125-8769-4b34-bf46-548c0970d989', '8f5f6691-b8eb-4ebe-80a0-99df60f12d93', '5864410b-33f5-49b5-bfec-6c2136f288b0'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:13:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Delete snapshot completed successfully. Jun 24 16:13:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-708e5658-0fc0-4db8-811d-5e3573aae883 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-c18dfd8f-80ff-461f-b64f-5489524b86e7-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "cinder-d97b9607-e762-4f8e-8819-e142173843e6-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-d97b9607-e762-4f8e-8819-e142173843e6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "cinder-quobyte-d97b9607-e762-4f8e-8819-e142173843e6" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-quobyte-d97b9607-e762-4f8e-8819-e142173843e6" acquired by "delete_volume" :: waited 0.012s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea1099f-4108-415d-925d-39dfc0797fe7]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:18 devstack sudo[111301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 Jun 24 16:13:18 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:18 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6" returned: 0 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:18 devstack sudo[111306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6 Jun 24 16:13:18 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:19 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d97b9607-e762-4f8e-8819-e142173843e6" returned: 0 in 0.661s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-quobyte-d97b9607-e762-4f8e-8819-e142173843e6" released by "delete_volume" :: held 1.453s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Created reservations ['9954a4cd-1619-48fe-8723-88c68635f2e4', 'd51e20fe-0a0a-4e83-8364-0a8dfd1c7b47', 'c5994edb-07d9-45c3-99eb-69d83bc05f97', '44b3d22c-5985-4700-825a-cfca2df35154'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:19 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:13:19 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:20 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.663s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:20 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:13:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Deleted volume successfully. Jun 24 16:13:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3477313-a58e-4637-a621-55ee9a532e12 tempest-VolumesSnapshotNegativeTestJSON-1071408808 None] Lock "cinder-d97b9607-e762-4f8e-8819-e142173843e6-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9822599-10a2-4f12-b59a-2aa03605ee76]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:26 devstack sudo[111324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 Jun 24 16:13:26 devstack sudo[111324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:26 devstack sudo[111324]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440" returned: 0 in 0.749s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-9087dff8-a176-4ec5-85cf-7641940b1440', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3642a16e-bdf1-4a93-af3d-847a9cddf06e', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:13:26 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-902c29bd-3cd7-4986-9727-b77802a20738 req-b90bb6c6-62e0-438a-ba71-98c862dbb90d tempest-TestServerVolumeAttachmentScenario-2012141750 None] attachment_update completed successfully. Jun 24 16:13:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-53340aaa-b637-429f-932a-15f527b5b38a req-839545c0-3698-469a-b0a6-e60cfe3f431e tempest-TestServerVolumeAttachmentScenario-2012141750 None] Terminate volume connection completed successfully. Jun 24 16:13:32 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-53340aaa-b637-429f-932a-15f527b5b38a req-839545c0-3698-469a-b0a6-e60cfe3f431e tempest-TestServerVolumeAttachmentScenario-2012141750 None] Deleting attachment 3642a16e-bdf1-4a93-af3d-847a9cddf06e. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:13:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-16828afb-cd1b-4caf-9131-fff6a0d8417f req-1bec3c23-5ef0-4981-b835-8d5d47eb0175 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Terminate volume connection completed successfully. Jun 24 16:13:36 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-16828afb-cd1b-4caf-9131-fff6a0d8417f req-1bec3c23-5ef0-4981-b835-8d5d47eb0175 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Deleting attachment 2c3215ae-9124-4745-9a37-7f3c444994e3. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:39 devstack sudo[111385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:13:39 devstack sudo[111385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:40 devstack sudo[111385]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.865s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:13:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:13:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:13:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:13:46 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=30,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:13:46 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=27,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=7 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:13:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "cinder-9087dff8-a176-4ec5-85cf-7641940b1440-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-9087dff8-a176-4ec5-85cf-7641940b1440-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "cinder-quobyte-9087dff8-a176-4ec5-85cf-7641940b1440" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:48 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-quobyte-9087dff8-a176-4ec5-85cf-7641940b1440" acquired by "delete_volume" :: waited 0.013s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ff8f78-7555-4900-a54f-0124461aaa45]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:48 devstack sudo[111431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 Jun 24 16:13:48 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:49 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440" returned: 0 in 0.815s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:49 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440 Jun 24 16:13:49 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:49 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9087dff8-a176-4ec5-85cf-7641940b1440" returned: 0 in 0.658s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-quobyte-9087dff8-a176-4ec5-85cf-7641940b1440" released by "delete_volume" :: held 1.511s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:49 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Created reservations ['1e71d7a4-89a9-4a5f-8833-70afc308d4bc', '57740ac1-3879-42db-a902-36585e52b3b3', '2303ca73-7eec-4e9e-ae8b-50a9d2d3cbcc', '3604adbe-dfbb-4788-b4cc-a996915f89c5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:50 devstack sudo[111441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:13:50 devstack sudo[111441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "cinder-fced2728-2c0b-4342-973e-760676147dab-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-fced2728-2c0b-4342-973e-760676147dab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "cinder-quobyte-fced2728-2c0b-4342-973e-760676147dab" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-quobyte-fced2728-2c0b-4342-973e-760676147dab" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e422bd-c633-4d4b-a285-3ce2c85e7819]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:50 devstack sudo[111441]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.715s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:13:50 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Deleted volume successfully. Jun 24 16:13:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6880e132-5c7c-4b24-8aef-f9d905907e37 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-9087dff8-a176-4ec5-85cf-7641940b1440-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:50 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab Jun 24 16:13:50 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:51 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab" returned: 0 in 0.836s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:51 devstack sudo[111450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab Jun 24 16:13:51 devstack sudo[111450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:52 devstack sudo[111450]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-fced2728-2c0b-4342-973e-760676147dab" returned: 0 in 0.715s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-quobyte-fced2728-2c0b-4342-973e-760676147dab" released by "delete_volume" :: held 1.604s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Created reservations ['25cc80db-a2ae-4613-a1ad-23485bfdf181', '95160817-7645-4aaa-8b41-beb1205c30c2', 'df0c1682-3c04-4b9f-aa0e-a0f13051486f', 'ff345994-02ef-476d-9ce7-a0660832365a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:13:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:13:52 devstack sudo[111468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:13:52 devstack sudo[111468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:13:53 devstack sudo[111468]: pam_unix(sudo:session): session closed for user root Jun 24 16:13:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.631s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:13:53 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:13:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Deleted volume successfully. Jun 24 16:13:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-76317dcc-4949-4143-b5a5-ef3ff5f2dd82 tempest-TestServerVolumeAttachmentScenario-2012141750 None] Lock "cinder-fced2728-2c0b-4342-973e-760676147dab-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:14:06 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:INSERT=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:14:06 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Flow 'volume_create_manager' (5bf41788-ba7b-448a-91f3-c7ceb819d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d7eff8-7d17-4dec-8130-17aed13de0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d7eff8-7d17-4dec-8130-17aed13de0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-954159439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cf7b0f-6599-4108-a253-71caf62a7412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655e3650534493e8b67c6b7ff0c589c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:14:22Z,use_quota=True,user_id='10cbfa36d0f24567a993b268068c9054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43174cf-ab11-4e6f-8db3-1c16e11b4198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43174cf-ab11-4e6f-8db3-1c16e11b4198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c51ccc8-9e5a-4348-942c-292ece4ecf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c51ccc8-9e5a-4348-942c-292ece4ecf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cf7b0f-6599-4108-a253-71caf62a7412', 'volume_name': 'volume-d4cf7b0f-6599-4108-a253-71caf62a7412', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c949be1f-fa93-4eb8-bd70-cea8c5de33ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c949be1f-fa93-4eb8-bd70-cea8c5de33ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9d87b9-e9f2-404b-b9d3-95c56771b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:14:22 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Volume d4cf7b0f-6599-4108-a253-71caf62a7412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cf7b0f-6599-4108-a253-71caf62a7412', 'volume_size': 1} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-954159439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cf7b0f-6599-4108-a253-71caf62a7412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e655e3650534493e8b67c6b7ff0c589c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:14:22Z,use_quota=True,user_id='10cbfa36d0f24567a993b268068c9054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Creating volume d4cf7b0f-6599-4108-a253-71caf62a7412 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:14:22 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:14:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:22 devstack sudo[111635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 1073741824 Jun 24 16:14:22 devstack sudo[111635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:23 devstack sudo[111635]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 1073741824" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:23 devstack sudo[111641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 Jun 24 16:14:23 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:23 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412" returned: 0 in 0.654s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9d87b9-e9f2-404b-b9d3-95c56771b088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cf7b0f-6599-4108-a253-71caf62a7412', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4575b60a-ed92-45a7-8002-a92db44efb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:14:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Volume volume-d4cf7b0f-6599-4108-a253-71caf62a7412 (d4cf7b0f-6599-4108-a253-71caf62a7412): created successfully Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4575b60a-ed92-45a7-8002-a92db44efb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:14:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Flow 'volume_create_manager' (5bf41788-ba7b-448a-91f3-c7ceb819d76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:14:23 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-c559d327-22ea-4ceb-add2-ce0e3be582f9 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Created volume successfully. Jun 24 16:14:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:14:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:14:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0820df-6f2d-4daf-af36-ad9c57e359fe]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:14:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:27 devstack sudo[111656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 Jun 24 16:14:27 devstack sudo[111656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:28 devstack sudo[111656]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:14:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-d4cf7b0f-6599-4108-a253-71caf62a7412', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a89138c-744d-498e-8209-87864b62104f', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:14:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-10fb1fb9-9dbb-41a0-b7fe-2e1f19184d1d req-6252322d-2981-467b-93ce-1f23ee328d99 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] attachment_update completed successfully. Jun 24 16:14:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-9c1e490c-48fd-4d2d-a350-fb7367d7aa14 req-340674da-f974-42e9-a668-96b4857bafb8 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Terminate volume connection completed successfully. Jun 24 16:14:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-9c1e490c-48fd-4d2d-a350-fb7367d7aa14 req-340674da-f974-42e9-a668-96b4857bafb8 tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Deleting attachment 3a89138c-744d-498e-8209-87864b62104f. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:14:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Acquiring lock "cinder-d4cf7b0f-6599-4108-a253-71caf62a7412-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:14:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "cinder-d4cf7b0f-6599-4108-a253-71caf62a7412-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:14:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Acquiring lock "cinder-quobyte-d4cf7b0f-6599-4108-a253-71caf62a7412" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:14:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "cinder-quobyte-d4cf7b0f-6599-4108-a253-71caf62a7412" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:14:36 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3164758d-8bc5-4231-8a6b-dd791c825992]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:14:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:36 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 Jun 24 16:14:36 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:37 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412" returned: 0 in 0.747s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:37 devstack sudo[112088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412 Jun 24 16:14:37 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:38 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-d4cf7b0f-6599-4108-a253-71caf62a7412" returned: 0 in 0.622s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "cinder-quobyte-d4cf7b0f-6599-4108-a253-71caf62a7412" released by "delete_volume" :: held 1.404s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Created reservations ['7bbeec0d-96b4-4d1c-8ead-77b421893ddd', '74da7f20-e2ea-4d1c-89bf-fb71e95bff44', '51a09241-32a2-4ccd-a5cf-28bf0f02a024', 'f38680f1-7ac4-4b49-a3fc-4b0a3b2ae292'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:38 devstack sudo[112091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:14:38 devstack sudo[112091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:38 devstack sudo[112091]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.616s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:14:38 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Deleted volume successfully. Jun 24 16:14:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d872854c-ac48-4b44-be0b-141a9d15aa3f tempest-TestServerVolumeAttachScenarioOldVersion-1202276005 None] Lock "cinder-d4cf7b0f-6599-4108-a253-71caf62a7412-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:14:39 devstack sudo[112094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:14:39 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:14:39 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.638s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:14:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:14:48 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=15,cinder:SELECT=14,cinder:INSERT=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:14:48 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:15:16 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Flow 'volume_create_manager' (df1b2384-9e5e-4303-a768-c7f1c246cfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8fb2eeb-02fa-46d2-b656-c014dab22548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8fb2eeb-02fa-46d2-b656-c014dab22548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1912436691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49157232-ec62-43da-8aa3-a688ef3ab8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0ae940bb7346fb8b9abc70a52bb16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:15:17Z,use_quota=True,user_id='31b2792515b04be28390d1d5ed117885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b7cc64-71af-437f-b242-0a7af676eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b7cc64-71af-437f-b242-0a7af676eb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13321b0d-0788-44d2-98fe-0afa39ac9d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13321b0d-0788-44d2-98fe-0afa39ac9d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49157232-ec62-43da-8aa3-a688ef3ab8a8', 'volume_name': 'volume-49157232-ec62-43da-8aa3-a688ef3ab8a8', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0658ba9-3c88-4e5d-b1b7-86edf21aec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0658ba9-3c88-4e5d-b1b7-86edf21aec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414198c1-a472-4664-9512-89b785e0e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:15:17 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Volume 49157232-ec62-43da-8aa3-a688ef3ab8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49157232-ec62-43da-8aa3-a688ef3ab8a8', 'volume_size': 1} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1912436691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49157232-ec62-43da-8aa3-a688ef3ab8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0ae940bb7346fb8b9abc70a52bb16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:15:17Z,use_quota=True,user_id='31b2792515b04be28390d1d5ed117885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Creating volume 49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:15:17 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:15:17 devstack sudo[112194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 1073741824 Jun 24 16:15:17 devstack sudo[112194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:15:17 devstack sudo[112194]: pam_unix(sudo:session): session closed for user root Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 1073741824" returned: 0 in 0.881s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:15:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:15:18 devstack sudo[112203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:15:18 devstack sudo[112203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:15:18 devstack sudo[112203]: pam_unix(sudo:session): session closed for user root Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.653s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414198c1-a472-4664-9512-89b785e0e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49157232-ec62-43da-8aa3-a688ef3ab8a8', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae91481-b72a-4a3c-8147-a802866c2ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:15:18 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Volume volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 (49157232-ec62-43da-8aa3-a688ef3ab8a8): created successfully Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae91481-b72a-4a3c-8147-a802866c2ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:15:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Flow 'volume_create_manager' (df1b2384-9e5e-4303-a768-c7f1c246cfb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:15:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0d4dedef-f00a-4134-81c2-962f2e029f86 tempest-TestStampPattern-1708333867 None] Created volume successfully. Jun 24 16:15:28 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:15:28 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:15:39 devstack sudo[112320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:15:39 devstack sudo[112320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:15:39 devstack sudo[112320]: pam_unix(sudo:session): session closed for user root Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.648s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:15:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:15:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:15:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:15:57 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a3a936-ac97-4668-b505-2b917793815a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:15:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:15:57 devstack sudo[112356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:15:57 devstack sudo[112356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:15:58 devstack sudo[112356]: pam_unix(sudo:session): session closed for user root Jun 24 16:15:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.766s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:15:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:15:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-49157232-ec62-43da-8aa3-a688ef3ab8a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5beb09c-39b2-4360-a79c-bf913063ea11', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:15:58 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-2f6d2535-8de4-420b-92d0-0cc88cd4738c req-38fa82e5-6ff0-40ed-bfc4-a5d5c555c573 tempest-TestStampPattern-1708333867 None] attachment_update completed successfully. Jun 24 16:16:06 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-ea0cda5a-4173-47fc-9913-47eb4c731eca req-85a6673f-87fb-4487-b877-a373468f7fc9 tempest-TestStampPattern-1708333867 None] Terminate volume connection completed successfully. Jun 24 16:16:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-ea0cda5a-4173-47fc-9913-47eb4c731eca req-85a6673f-87fb-4487-b877-a373468f7fc9 tempest-TestStampPattern-1708333867 None] Deleting attachment e5beb09c-39b2-4360-a79c-bf913063ea11. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:16:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:16:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:16:08 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Creating offline snapshot f922b736-2060-414a-85a3-cae331e5706d of volume 49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:16:08 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb73687-48dd-4ad0-a61a-b2e34233ec97]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:16:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:08 devstack sudo[112838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:16:08 devstack sudo[112838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:09 devstack sudo[112838]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.738s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:09 devstack sudo[112844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d 1G Jun 24 16:16:09 devstack sudo[112844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:09 devstack sudo[112844]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d 1G" returned: 0 in 0.796s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:09 devstack sudo[112857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d Jun 24 16:16:09 devstack sudo[112857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:10 devstack sudo[112857]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d" returned: 0 in 0.669s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:10 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d is being set with open permissions: ugo+rw Jun 24 16:16:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:10 devstack sudo[112862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d Jun 24 16:16:10 devstack sudo[112862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:11 devstack sudo[112862]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d" returned: 0 in 0.630s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:11 devstack sudo[112865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info Jun 24 16:16:11 devstack sudo[112865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:11 devstack sudo[112865]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:11 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info is being set with open permissions: ugo+rw Jun 24 16:16:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:11 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info Jun 24 16:16:11 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:12 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.info" returned: 0 in 0.623s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.182s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:16:12 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6ed981ac-41dc-4f6f-943c-41d30ed77734 tempest-TestStampPattern-1708333867 None] Create snapshot completed successfully Jun 24 16:16:22 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:16:22 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Flow 'volume_create_manager' (feac6e84-cb84-4cf9-a123-a729e0a3e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f01b0-7f29-418f-a724-87db7b7190c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f01b0-7f29-418f-a724-87db7b7190c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1213889176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6925ef08-74f4-43a4-adcf-874b5afdd375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f0ae940bb7346fb8b9abc70a52bb16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f922b736-2060-414a-85a3-cae331e5706d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:16:23Z,use_quota=True,user_id='31b2792515b04be28390d1d5ed117885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4c7b59-da71-489e-a80d-804832c88e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4c7b59-da71-489e-a80d-804832c88e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08eb2ec0-67c6-4309-a1cb-d9f0740f88c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08eb2ec0-67c6-4309-a1cb-d9f0740f88c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6925ef08-74f4-43a4-adcf-874b5afdd375', 'volume_name': 'volume-6925ef08-74f4-43a4-adcf-874b5afdd375', 'volume_size': 1, 'snapshot_id': 'f922b736-2060-414a-85a3-cae331e5706d'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b6dbb4-aa74-43a3-88eb-980bdd6ca67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b6dbb4-aa74-43a3-88eb-980bdd6ca67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49562e8a-f690-467c-a3fa-b492643c0fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:16:23 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Volume 6925ef08-74f4-43a4-adcf-874b5afdd375: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6925ef08-74f4-43a4-adcf-874b5afdd375', 'volume_size': 1, 'snapshot_id': 'f922b736-2060-414a-85a3-cae331e5706d'} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-quobyte-f922b736-2060-414a-85a3-cae331e5706d-6925ef08-74f4-43a4-adcf-874b5afdd375" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-f922b736-2060-414a-85a3-cae331e5706d-6925ef08-74f4-43a4-adcf-874b5afdd375" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Creating volume 6925ef08-74f4-43a4-adcf-874b5afdd375 from snapshot f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-quobyte-6925ef08-74f4-43a4-adcf-874b5afdd375" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-6925ef08-74f4-43a4-adcf-874b5afdd375" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] snapshot: f922b736-2060-414a-85a3-cae331e5706d, volume: 6925ef08-74f4-43a4-adcf-874b5afdd375, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7a977-49e5-494b-bbe7-c251885a9afc]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:16:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:23 devstack sudo[112908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d Jun 24 16:16:23 devstack sudo[112908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:24 devstack sudo[112908]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d" returned: 0 in 0.783s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49157232-ec62-43da-8aa3-a688ef3ab8a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4729ffa-9399-4a47-80dc-7fecb0f9c412]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:24 devstack sudo[112917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:16:24 devstack sudo[112917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:24 devstack sudo[112917]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.759s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:16:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:24 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 Jun 24 16:16:24 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:29 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375" returned: 0 in 4.966s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b22f669-35cc-48a7-80f6-6bf45f3de1e6]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:16:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:30 devstack sudo[112935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:16:30 devstack sudo[112935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:31 devstack sudo[112935]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 1.151s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:16:31 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Converted 1024.00 MB image at 206.13 MB/s Jun 24 16:16:31 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 is being set with open permissions: ugo+rw Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:31 devstack sudo[112941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 Jun 24 16:16:31 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:31 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375" returned: 0 in 0.835s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-6925ef08-74f4-43a4-adcf-874b5afdd375" released by "_copy_volume_from_snapshot" :: held 8.591s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-f922b736-2060-414a-85a3-cae331e5706d-6925ef08-74f4-43a4-adcf-874b5afdd375" released by "_create_volume_from_snapshot" :: held 8.622s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.637s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49562e8a-f690-467c-a3fa-b492643c0fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6925ef08-74f4-43a4-adcf-874b5afdd375', 'volume_size': 1, 'snapshot_id': 'f922b736-2060-414a-85a3-cae331e5706d'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3cee71-d481-4b32-99b0-b99aa01e61c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:16:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Volume volume-6925ef08-74f4-43a4-adcf-874b5afdd375 (6925ef08-74f4-43a4-adcf-874b5afdd375): created successfully Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3cee71-d481-4b32-99b0-b99aa01e61c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:16:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Flow 'volume_create_manager' (feac6e84-cb84-4cf9-a123-a729e0a3e980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:16:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1aa05e4b-8cd4-422d-ac08-58ea9386c99b tempest-TestStampPattern-1708333867 None] Created volume successfully. Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:16:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:16:39 devstack sudo[113037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:16:39 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:16:40 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root Jun 24 16:16:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.789s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:16:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:16:40 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:16:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:16:40 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:16:41 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:16:42 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:17:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:17:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:17:21 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[27270eb4-a4c2-4864-986e-4564c1b9bbd1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:17:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:21 devstack sudo[113129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 Jun 24 16:17:21 devstack sudo[113129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:22 devstack sudo[113129]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375" returned: 0 in 0.756s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:17:22 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56', 'name': 'volume-6925ef08-74f4-43a4-adcf-874b5afdd375', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9938ef6-a3ea-4750-ad5c-8d73b1308615', 'enforce_multipath': True} {{(pid=93867) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 16:17:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-d81bb4f3-608c-4fff-9c03-369d784be353 req-d1d05e40-fcb6-41a2-9721-37a1f51ca139 tempest-TestStampPattern-1708333867 None] attachment_update completed successfully. Jun 24 16:17:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [req-805da7df-71ea-4563-a235-62008dfc2be7 req-46622283-c6d5-4942-a5e6-32f00ce7da5d tempest-TestStampPattern-1708333867 None] Terminate volume connection completed successfully. Jun 24 16:17:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [req-805da7df-71ea-4563-a235-62008dfc2be7 req-46622283-c6d5-4942-a5e6-32f00ce7da5d tempest-TestStampPattern-1708333867 None] Deleting attachment d9938ef6-a3ea-4750-ad5c-8d73b1308615. {{(pid=93867) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 16:17:32 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:17:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-6925ef08-74f4-43a4-adcf-874b5afdd375-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Lock "cinder-6925ef08-74f4-43a4-adcf-874b5afdd375-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-quobyte-6925ef08-74f4-43a4-adcf-874b5afdd375" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-6925ef08-74f4-43a4-adcf-874b5afdd375" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:38 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[62042388-7c8e-4aef-9f6f-51cd99dce262]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:17:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:38 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 Jun 24 16:17:38 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:38 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375" returned: 0 in 0.766s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:38 devstack sudo[113622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375 Jun 24 16:17:38 devstack sudo[113622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:39 devstack sudo[113624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:17:39 devstack sudo[113624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:39 devstack sudo[113622]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-6925ef08-74f4-43a4-adcf-874b5afdd375" returned: 0 in 0.647s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-6925ef08-74f4-43a4-adcf-874b5afdd375" released by "delete_volume" :: held 1.452s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Created reservations ['2f19bc84-e08d-4c29-94ef-974ce0d3fead', '231ca04b-1918-4bc1-8ee3-6a6ef29ca3fb', '2559a3bd-c74f-4fa7-9bef-9b40959a77bb', '6436d053-afc7-489a-a19b-f129a990ca6e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:39 devstack sudo[113627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:17:39 devstack sudo[113627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:39 devstack sudo[113624]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.649s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:17:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:17:40 devstack sudo[113627]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.643s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:17:40 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Deleted volume successfully. Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-258a5b2d-2827-4db6-87d3-36b65eb44fc7 tempest-TestStampPattern-1708333867 None] Lock "cinder-6925ef08-74f4-43a4-adcf-874b5afdd375-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-f922b736-2060-414a-85a3-cae331e5706d-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Lock "cinder-f922b736-2060-414a-85a3-cae331e5706d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-quobyte-49157232-ec62-43da-8aa3-a688ef3ab8a8" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-49157232-ec62-43da-8aa3-a688ef3ab8a8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-quobyte-f922b736-2060-414a-85a3-cae331e5706d" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-f922b736-2060-414a-85a3-cae331e5706d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Deleting offline snapshot f922b736-2060-414a-85a3-cae331e5706d of volume 49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] snapshot_file for this snap is: volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4790feeb-3fe7-442a-8b6e-ece8def9b97c]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:17:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:40 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d Jun 24 16:17:40 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:41 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d" returned: 0 in 0.755s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49157232-ec62-43da-8aa3-a688ef3ab8a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:17:41 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e7b9b-1e17-4f56-99ab-01a1b9c4116d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:17:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:41 devstack sudo[113637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:17:41 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:42 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.750s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:42 devstack sudo[113642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d Jun 24 16:17:42 devstack sudo[113642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:42 devstack sudo[113642]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d" returned: 0 in 0.732s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:42 devstack sudo[113648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d Jun 24 16:17:42 devstack sudo[113648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:43 devstack sudo[113648]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8.f922b736-2060-414a-85a3-cae331e5706d" returned: 0 in 0.628s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-f922b736-2060-414a-85a3-cae331e5706d" released by "_delete_snapshot" :: held 2.958s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:17:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-49157232-ec62-43da-8aa3-a688ef3ab8a8" released by "delete_snapshot" :: held 2.983s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:17:43 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Created reservations ['40ca17ec-9b58-4fe2-9beb-366101ef0cf8', 'c7768fc8-c6a3-44af-b1f0-9ef8dba80865', 'e94a8a6b-4067-4b19-b2e3-2b704921e97a', 'ff62b173-072b-4490-b096-a12736c602a3'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:17:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Delete snapshot completed successfully. Jun 24 16:17:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6710869b-76bc-4cf7-bec4-35d7c53db37f tempest-TestStampPattern-1708333867 None] Lock "cinder-f922b736-2060-414a-85a3-cae331e5706d-delete_snapshot" released by "delete_snapshot" :: held 3.115s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:17:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-49157232-ec62-43da-8aa3-a688ef3ab8a8-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Lock "cinder-49157232-ec62-43da-8aa3-a688ef3ab8a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Acquiring lock "cinder-quobyte-49157232-ec62-43da-8aa3-a688ef3ab8a8" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:17:51 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-49157232-ec62-43da-8aa3-a688ef3ab8a8" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:17:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ecd7d-dda2-4810-a31b-c907006a4bc3]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:17:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:51 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:17:51 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:52 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:52 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8 Jun 24 16:17:52 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:53 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-49157232-ec62-43da-8aa3-a688ef3ab8a8" returned: 0 in 0.661s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Lock "cinder-quobyte-49157232-ec62-43da-8aa3-a688ef3ab8a8" released by "delete_volume" :: held 1.494s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Created reservations ['90556c22-0fd2-48c6-91d3-3c3af8504186', 'df2bf4fe-d874-4abf-9965-b3af09df670e', 'fe976e22-b49a-4b48-b3fa-b89af9171307', '8d884423-4122-49be-b1db-18cdc9496866'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:17:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:17:53 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:17:53 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:17:54 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Jun 24 16:17:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:17:54 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:17:54 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Deleted volume successfully. Jun 24 16:17:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-215124c7-77e7-4aa0-ba85-a1a585c87283 tempest-TestStampPattern-1708333867 None] Lock "cinder-49157232-ec62-43da-8aa3-a688ef3ab8a8-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:04 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=8,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:18:06 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Flow 'volume_create_manager' (c7f194de-ce62-4c46-9f66-5721ecd91dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ddb275-3c1e-41d9-976c-b3d089c4b66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ddb275-3c1e-41d9-976c-b3d089c4b66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e361266-1a1a-4167-ac9e-c0537752ed31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c87c7ee4920c4a55aec14958f4e63675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:08Z,use_quota=True,user_id='47aaa36cbf60481cb55084263579061c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033575c5-240f-4ff1-a4b3-d99d89317046),volume_type_id=033575c5-240f-4ff1-a4b3-d99d89317046)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5805cef3-6128-4258-a645-cb9c34b2abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5805cef3-6128-4258-a645-cb9c34b2abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7308ffbd-254c-430e-9da3-a4689aa01684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:07 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7308ffbd-254c-430e-9da3-a4689aa01684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e361266-1a1a-4167-ac9e-c0537752ed31', 'volume_name': 'volume-5e361266-1a1a-4167-ac9e-c0537752ed31', 'volume_size': 1, 'image_id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eadccb0a-13b9-4be8-b43f-1ea96a446556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '284a0bcd17b85a5a46dd0e4f1fa9ac7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c87c7ee4920c4a55aec14958f4e63675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '200dda9d5ba4cb0a48feb5bfb76d500e9341542f8095ea645c258bb7116d5b4602683ec2920bb8b581ca037d1bca15701a2c22aab0a67465904986432571220a', 'id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'created_at': datetime.datetime(2026, 6, 24, 14, 18, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 18, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eadccb0a-13b9-4be8-b43f-1ea96a446556/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d857d7-6c5e-44f0-b442-66b98b9f894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d857d7-6c5e-44f0-b442-66b98b9f894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071b678a-5e57-4cae-9c56-650475caf027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:08 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Volume 5e361266-1a1a-4167-ac9e-c0537752ed31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e361266-1a1a-4167-ac9e-c0537752ed31', 'volume_size': 1, 'image_id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eadccb0a-13b9-4be8-b43f-1ea96a446556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '284a0bcd17b85a5a46dd0e4f1fa9ac7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c87c7ee4920c4a55aec14958f4e63675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '200dda9d5ba4cb0a48feb5bfb76d500e9341542f8095ea645c258bb7116d5b4602683ec2920bb8b581ca037d1bca15701a2c22aab0a67465904986432571220a', 'id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'created_at': datetime.datetime(2026, 6, 24, 14, 18, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 18, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eadccb0a-13b9-4be8-b43f-1ea96a446556/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Trying to clone 5e361266-1a1a-4167-ac9e-c0537752ed31 from image eadccb0a-13b9-4be8-b43f-1ea96a446556 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eadccb0a-13b9-4be8-b43f-1ea96a446556', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:18:08 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Image download 0.00 MB at 0.00 MB/s Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed0de1d-2763-4eef-a5bf-64e8e7231aa2]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:08 devstack sudo[113758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD Jun 24 16:18:08 devstack sudo[113758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:09 devstack sudo[113758]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:09 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD Jun 24 16:18:09 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:09 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Temporary image eadccb0a-13b9-4be8-b43f-1ea96a446556 is fetched for user 47aaa36cbf60481cb55084263579061c. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db61ce-200b-44f9-b3c0-98ac6e764771]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:10 devstack sudo[113767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD Jun 24 16:18:10 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:10 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:10 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD Jun 24 16:18:10 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:11 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e361266-1a1a-4167-ac9e-c0537752ed31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c87c7ee4920c4a55aec14958f4e63675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:08Z,use_quota=True,user_id='47aaa36cbf60481cb55084263579061c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033575c5-240f-4ff1-a4b3-d99d89317046),volume_type_id=033575c5-240f-4ff1-a4b3-d99d89317046)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Creating volume 5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:11 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:11 devstack sudo[113778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 1073741824 Jun 24 16:18:11 devstack sudo[113778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:12 devstack sudo[113778]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 1073741824" returned: 0 in 0.859s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:12 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:12 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:13 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 0 in 0.656s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Attempting download of eadccb0a-13b9-4be8-b43f-1ea96a446556 ((None, [{'url': 'file:///opt/stack/data/glance/images/eadccb0a-13b9-4be8-b43f-1ea96a446556', 'metadata': {}}])) to volume 5e361266-1a1a-4167-ac9e-c0537752ed31. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff87094-afb0-401f-8324-771e90232c63]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:13 devstack sudo[113786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu Jun 24 16:18:13 devstack sudo[113786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:13 devstack sudo[113786]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu" returned: 0 in 0.715s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:13 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu Jun 24 16:18:13 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:14 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu" returned: 1 in 0.723s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eadccb0a-13b9-4be8-b43f-1ea96a446556_3ht54stu' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:18:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2a3600-f20c-4188-90d9-194690f50cac]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:14 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD Jun 24 16:18:14 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:15 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:15 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD Jun 24 16:18:15 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:16 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] eadccb0a-13b9-4be8-b43f-1ea96a446556 was raw, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:16 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:16 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:16 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 0 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eadccb0a-13b9-4be8-b43f-1ea96a446556_ohyixrycdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:18:16 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 16:18:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:16 devstack sudo[113809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 1G Jun 24 16:18:16 devstack sudo[113809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:17 devstack sudo[113809]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 1G" returned: 0 in 0.688s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f701ac5-fb32-4b5e-b2be-46861928a9b4]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:17 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:17 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:18 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 0 in 0.739s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:18 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:18 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:18 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 1 in 0.733s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Downloaded image eadccb0a-13b9-4be8-b43f-1ea96a446556 ((None, [{'url': 'file:///opt/stack/data/glance/images/eadccb0a-13b9-4be8-b43f-1ea96a446556', 'metadata': {}}])) to volume 5e361266-1a1a-4167-ac9e-c0537752ed31 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Temporary image eadccb0a-13b9-4be8-b43f-1ea96a446556 for user 47aaa36cbf60481cb55084263579061c is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Marking volume 5e361266-1a1a-4167-ac9e-c0537752ed31 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Copying metadata from image eadccb0a-13b9-4be8-b43f-1ea96a446556 to 5e361266-1a1a-4167-ac9e-c0537752ed31. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:18:18 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Creating volume glance metadata for volume 5e361266-1a1a-4167-ac9e-c0537752ed31 backed by image eadccb0a-13b9-4be8-b43f-1ea96a446556 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '284a0bcd17b85a5a46dd0e4f1fa9ac7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071b678a-5e57-4cae-9c56-650475caf027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e361266-1a1a-4167-ac9e-c0537752ed31', 'volume_size': 1, 'image_id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eadccb0a-13b9-4be8-b43f-1ea96a446556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '284a0bcd17b85a5a46dd0e4f1fa9ac7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c87c7ee4920c4a55aec14958f4e63675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '200dda9d5ba4cb0a48feb5bfb76d500e9341542f8095ea645c258bb7116d5b4602683ec2920bb8b581ca037d1bca15701a2c22aab0a67465904986432571220a', 'id': 'eadccb0a-13b9-4be8-b43f-1ea96a446556', 'created_at': datetime.datetime(2026, 6, 24, 14, 18, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 18, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eadccb0a-13b9-4be8-b43f-1ea96a446556/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb6f968-fd17-4266-892b-c344badfc02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:19 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Volume volume-5e361266-1a1a-4167-ac9e-c0537752ed31 (5e361266-1a1a-4167-ac9e-c0537752ed31): created successfully Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb6f968-fd17-4266-892b-c344badfc02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Flow 'volume_create_manager' (c7f194de-ce62-4c46-9f66-5721ecd91dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d8aefff2-6026-4212-8803-0fdc52c48eb5 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Created volume successfully. Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Acquiring lock "cinder-5e361266-1a1a-4167-ac9e-c0537752ed31-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "cinder-5e361266-1a1a-4167-ac9e-c0537752ed31-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Acquiring lock "cinder-quobyte-5e361266-1a1a-4167-ac9e-c0537752ed31" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "cinder-quobyte-5e361266-1a1a-4167-ac9e-c0537752ed31" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f02adf-8162-4b7e-ac94-053d97f07561]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:19 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:19 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:20 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 0 in 0.729s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:20 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:20 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:21 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 1 in 0.713s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:21 devstack sudo[113832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31 Jun 24 16:18:21 devstack sudo[113832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:21 devstack sudo[113832]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5e361266-1a1a-4167-ac9e-c0537752ed31" returned: 0 in 0.636s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "cinder-quobyte-5e361266-1a1a-4167-ac9e-c0537752ed31" released by "delete_volume" :: held 2.137s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:21 devstack cinder-volume[93867]: WARNING cinder.quota [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:18:21 devstack cinder-volume[93867]: WARNING cinder.quota [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Created reservations ['009a280c-cada-4462-bb2b-bd4d6edd5c28', '3fb2954e-e520-4dc2-b956-e3da459d81e8', '8b7ac7f2-c7a8-48b5-ae07-fa26e588c215', 'ca0dc4a1-b01c-4818-9cae-82f344388bea'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:21 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:21 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:22 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.623s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:22 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Deleted volume successfully. Jun 24 16:18:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-7fb8a5a5-e432-47bf-839d-e096d41f0462 tempest-VolumeAndVolumeTypeFromImageTest-1564634415 None] Lock "cinder-5e361266-1a1a-4167-ac9e-c0537752ed31-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (9513f3fe-ca72-4e46-b85f-d6da75fbb2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d93b08-7097-42b0-87ca-ca43e6de4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d93b08-7097-42b0-87ca-ca43e6de4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163152116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003f16e3-ab56-487f-831c-dcb97412bece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:27Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9087a271-ea8a-4d60-af3a-3d6ad419e77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9087a271-ea8a-4d60-af3a-3d6ad419e77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e23c9dd-f0de-4218-b399-41f4f021990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e23c9dd-f0de-4218-b399-41f4f021990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003f16e3-ab56-487f-831c-dcb97412bece', 'volume_name': 'volume-003f16e3-ab56-487f-831c-dcb97412bece', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed34cbe0-656e-41f4-aee4-aa32d6ed3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed34cbe0-656e-41f4-aee4-aa32d6ed3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a5263-d66c-46d3-942b-8fc8190ccb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:26 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Volume 003f16e3-ab56-487f-831c-dcb97412bece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003f16e3-ab56-487f-831c-dcb97412bece', 'volume_size': 1} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-163152116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003f16e3-ab56-487f-831c-dcb97412bece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:27Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Creating volume 003f16e3-ab56-487f-831c-dcb97412bece {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:26 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:26 devstack sudo[113839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece 1073741824 Jun 24 16:18:26 devstack sudo[113839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (da36d1eb-ca41-446e-ab80-38836babfda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c0336e-9753-4dd4-bde6-1180aca6604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c0336e-9753-4dd4-bde6-1180aca6604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798376916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fc2b4a-eeb2-4265-ba5d-59b224be1275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:27Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6545d9d4-52e3-4792-8ed1-c85fe1ee752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6545d9d4-52e3-4792-8ed1-c85fe1ee752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a490665-5d0c-469f-a36b-944ef4b12151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a490665-5d0c-469f-a36b-944ef4b12151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fc2b4a-eeb2-4265-ba5d-59b224be1275', 'volume_name': 'volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaa57ca-5b07-4b06-bc09-8c0b192ae529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaa57ca-5b07-4b06-bc09-8c0b192ae529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3011f109-93f5-4bba-b8fc-1b6e7106e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Volume 92fc2b4a-eeb2-4265-ba5d-59b224be1275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275', 'volume_size': 1} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (6c87c678-1864-4923-9476-8c5f0ebb2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c825dfe-dd2e-479d-9c55-805ab00956fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c825dfe-dd2e-479d-9c55-805ab00956fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493831642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d17d44-b43c-401f-96ad-7b9f4c0d35fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:27Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49605737-09cd-4bc0-ba37-b1c2c262163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49605737-09cd-4bc0-ba37-b1c2c262163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cdd149-26fe-4652-a2ff-aa3e5c88b290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cdd149-26fe-4652-a2ff-aa3e5c88b290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d17d44-b43c-401f-96ad-7b9f4c0d35fe', 'volume_name': 'volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45e3058-73ef-4318-8222-3a390fa4590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45e3058-73ef-4318-8222-3a390fa4590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf6c434-6d60-435c-b7ee-17f9ec644562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Volume c9d17d44-b43c-401f-96ad-7b9f4c0d35fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe', 'volume_size': 1} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:27 devstack sudo[113839]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece 1073741824" returned: 0 in 0.941s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:27 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece Jun 24 16:18:27 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (51554bb4-e627-48b8-a1cb-9af34eba09cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a83c68-ebb8-4e50-816a-fe888849b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a83c68-ebb8-4e50-816a-fe888849b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1367196767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d4542d-556e-4eba-8984-b9496a25e93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:28Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473b486b-52e5-4ae3-bd84-9bde3ea1f71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473b486b-52e5-4ae3-bd84-9bde3ea1f71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f3814-04b6-4c3d-a345-209dbd153542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f3814-04b6-4c3d-a345-209dbd153542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d4542d-556e-4eba-8984-b9496a25e93b', 'volume_name': 'volume-50d4542d-556e-4eba-8984-b9496a25e93b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc992c0-8814-4ac3-826f-a679085a7f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc992c0-8814-4ac3-826f-a679085a7f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05668d1-7df6-4370-8e4d-7db0e992958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Volume 50d4542d-556e-4eba-8984-b9496a25e93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d4542d-556e-4eba-8984-b9496a25e93b', 'volume_size': 1} Jun 24 16:18:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (4b07e117-731c-4d10-becd-99fe04fabbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d001c194-80d5-45c0-b2bb-519c86ac4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d001c194-80d5-45c0-b2bb-519c86ac4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d71aa34-5397-404c-ad88-8d9e2fe16947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:28Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d66f986-82b2-4205-958e-f854729f2316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d66f986-82b2-4205-958e-f854729f2316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e56dd59-849a-4827-9617-8a5bab5fd42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e56dd59-849a-4827-9617-8a5bab5fd42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d71aa34-5397-404c-ad88-8d9e2fe16947', 'volume_name': 'volume-9d71aa34-5397-404c-ad88-8d9e2fe16947', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912094ea-44ed-4e83-a7fe-2d9e2753a385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912094ea-44ed-4e83-a7fe-2d9e2753a385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9c9675-ed4a-44f4-b0f8-1d83ee464e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Volume 9d71aa34-5397-404c-ad88-8d9e2fe16947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d71aa34-5397-404c-ad88-8d9e2fe16947', 'volume_size': 1} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:28 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece" returned: 0 in 0.687s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-798376916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fc2b4a-eeb2-4265-ba5d-59b224be1275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:27Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Creating volume 92fc2b4a-eeb2-4265-ba5d-59b224be1275 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:28 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:28 devstack sudo[113848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 1073741824 Jun 24 16:18:28 devstack sudo[113848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6a5263-d66c-46d3-942b-8fc8190ccb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003f16e3-ab56-487f-831c-dcb97412bece', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3258513-bc81-4470-b055-84491e62b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:28 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Volume volume-003f16e3-ab56-487f-831c-dcb97412bece (003f16e3-ab56-487f-831c-dcb97412bece): created successfully Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3258513-bc81-4470-b055-84491e62b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:28 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (9513f3fe-ca72-4e46-b85f-d6da75fbb2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:28 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f713af88-e29a-4051-9f4c-3e2e9a110bae tempest-CreateVolumesFromImageTest-1554309131 None] Created volume successfully. Jun 24 16:18:29 devstack sudo[113848]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 1073741824" returned: 0 in 0.825s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:29 devstack sudo[113854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 Jun 24 16:18:29 devstack sudo[113854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:30 devstack sudo[113854]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275" returned: 0 in 0.637s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493831642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d17d44-b43c-401f-96ad-7b9f4c0d35fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:27Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Creating volume c9d17d44-b43c-401f-96ad-7b9f4c0d35fe {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:30 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:30 devstack sudo[113857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe 1073741824 Jun 24 16:18:30 devstack sudo[113857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3011f109-93f5-4bba-b8fc-1b6e7106e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c57bbc-9957-4485-b2f2-de6cde5dfff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:30 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Volume volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 (92fc2b4a-eeb2-4265-ba5d-59b224be1275): created successfully Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c57bbc-9957-4485-b2f2-de6cde5dfff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (da36d1eb-ca41-446e-ab80-38836babfda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-267597ab-1063-46d8-ab93-8847068b0be4 tempest-CreateVolumesFromImageTest-1554309131 None] Created volume successfully. Jun 24 16:18:30 devstack sudo[113857]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe 1073741824" returned: 0 in 0.790s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:30 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe Jun 24 16:18:30 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:31 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe" returned: 0 in 0.624s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1367196767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d4542d-556e-4eba-8984-b9496a25e93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:28Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Creating volume 50d4542d-556e-4eba-8984-b9496a25e93b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:31 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:31 devstack sudo[113865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b 1073741824 Jun 24 16:18:31 devstack sudo[113865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf6c434-6d60-435c-b7ee-17f9ec644562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae0fb09-9900-49e8-b26a-369804492866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Volume volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe (c9d17d44-b43c-401f-96ad-7b9f4c0d35fe): created successfully Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae0fb09-9900-49e8-b26a-369804492866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (6c87c678-1864-4923-9476-8c5f0ebb2a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:31 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-004e7145-5b80-4ece-8961-52e59b001db9 tempest-CreateVolumesFromImageTest-1554309131 None] Created volume successfully. Jun 24 16:18:32 devstack sudo[113865]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b 1073741824" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:32 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b Jun 24 16:18:32 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:32 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b" returned: 0 in 0.640s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.619s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1422888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d71aa34-5397-404c-ad88-8d9e2fe16947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60e243ddc847ff8f8211b883e40c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:28Z,use_quota=True,user_id='84ee857946974648a029cd2cef940896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Creating volume 9d71aa34-5397-404c-ad88-8d9e2fe16947 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:32 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:33 devstack sudo[113880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 1073741824 Jun 24 16:18:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05668d1-7df6-4370-8e4d-7db0e992958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d4542d-556e-4eba-8984-b9496a25e93b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:33 devstack sudo[113880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea454e7f-3184-4694-ae59-05c012cd0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:33 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Volume volume-50d4542d-556e-4eba-8984-b9496a25e93b (50d4542d-556e-4eba-8984-b9496a25e93b): created successfully Jun 24 16:18:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea454e7f-3184-4694-ae59-05c012cd0098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:33 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (51554bb4-e627-48b8-a1cb-9af34eba09cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-200c1ff0-74ce-4712-aa56-28898adc4e19 tempest-CreateVolumesFromImageTest-1554309131 None] Created volume successfully. Jun 24 16:18:33 devstack sudo[113880]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 1073741824" returned: 0 in 0.824s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:33 devstack sudo[113886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 Jun 24 16:18:33 devstack sudo[113886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:34 devstack sudo[113886]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947" returned: 0 in 0.631s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9c9675-ed4a-44f4-b0f8-1d83ee464e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d71aa34-5397-404c-ad88-8d9e2fe16947', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a479ece9-bd73-4602-bb96-c22148ae104e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:34 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Volume volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 (9d71aa34-5397-404c-ad88-8d9e2fe16947): created successfully Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a479ece9-bd73-4602-bb96-c22148ae104e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Flow 'volume_create_manager' (4b07e117-731c-4d10-becd-99fe04fabbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-b6da5cb4-40a6-46cf-b3c4-a75c8123b7af tempest-CreateVolumesFromImageTest-1554309131 None] Created volume successfully. Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-9d71aa34-5397-404c-ad88-8d9e2fe16947-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-9d71aa34-5397-404c-ad88-8d9e2fe16947-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-quobyte-9d71aa34-5397-404c-ad88-8d9e2fe16947" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-9d71aa34-5397-404c-ad88-8d9e2fe16947" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310b9bd-f8af-4dcf-8b32-515333f54702]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:34 devstack sudo[113889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 Jun 24 16:18:34 devstack sudo[113889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:35 devstack sudo[113889]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947" returned: 0 in 0.729s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:35 devstack sudo[113894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947 Jun 24 16:18:35 devstack sudo[113894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:36 devstack sudo[113894]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-9d71aa34-5397-404c-ad88-8d9e2fe16947" returned: 0 in 0.632s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-9d71aa34-5397-404c-ad88-8d9e2fe16947" released by "delete_volume" :: held 1.395s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Created reservations ['346c1d3d-28e9-4efc-b812-8258bf58965d', '2ba9234c-1016-4055-99b4-0c968e9a1235', '4f856024-abfc-4a9c-b3a0-2cf9db86b879', 'a579f58d-317e-497d-a523-05cf05ca45c5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:36 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:36 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:36 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.624s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:36 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Deleted volume successfully. Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-39823a3b-f7be-4f93-a18d-6b2dde985c6a tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-9d71aa34-5397-404c-ad88-8d9e2fe16947-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-50d4542d-556e-4eba-8984-b9496a25e93b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-50d4542d-556e-4eba-8984-b9496a25e93b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-quobyte-50d4542d-556e-4eba-8984-b9496a25e93b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-50d4542d-556e-4eba-8984-b9496a25e93b" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58641a9-39ba-49f8-90a7-09569ee5289a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:37 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b Jun 24 16:18:37 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:37 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b" returned: 0 in 0.745s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:37 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b Jun 24 16:18:37 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:38 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-50d4542d-556e-4eba-8984-b9496a25e93b" returned: 0 in 0.634s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-50d4542d-556e-4eba-8984-b9496a25e93b" released by "delete_volume" :: held 1.418s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Created reservations ['5102cbb3-cdf5-4641-9655-0a851be597af', '7c501e6f-e570-4b26-ba6e-ece612c9264c', '9be9b30c-9f5c-41df-9d07-1f420cf523c0', '64b7f231-ecf0-4931-9bf2-37f535387a71'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:38 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:38 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:38 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:39 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.646s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:39 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Deleted volume successfully. Jun 24 16:18:39 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:39 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-1b63c3a6-1ff2-4139-80d7-9bb5218c64d7 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-50d4542d-556e-4eba-8984-b9496a25e93b-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-quobyte-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c89e40-b28c-464d-8a96-b7d3105bfb68]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:39 devstack sudo[113913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe Jun 24 16:18:39 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:39 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:18:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:18:40 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe" returned: 0 in 0.757s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:40 devstack sudo[113919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe Jun 24 16:18:40 devstack sudo[113919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:40 devstack sudo[113919]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:40 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe" returned: 0 in 0.624s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:40 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe" released by "delete_volume" :: held 1.421s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Created reservations ['70d0ebb3-85b0-42ac-91cf-9625a333feb3', 'fe8be69a-d187-4785-9cff-a4f7bf7f6126', '15d043b1-fee0-4d66-b5e0-b7014fd1e919', '0b1a938f-d954-408a-befc-63b5b8f79624'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:41 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:41 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-92fc2b4a-eeb2-4265-ba5d-59b224be1275-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:41 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.640s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-92fc2b4a-eeb2-4265-ba5d-59b224be1275-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:41 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Deleted volume successfully. Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-89180c59-099f-4759-ae74-3c756feb81d9 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-c9d17d44-b43c-401f-96ad-7b9f4c0d35fe-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-quobyte-92fc2b4a-eeb2-4265-ba5d-59b224be1275" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-92fc2b4a-eeb2-4265-ba5d-59b224be1275" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6452029b-b76f-4aa2-b903-f8f3b51acd5d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:41 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 Jun 24 16:18:41 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:42 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275" returned: 0 in 0.735s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:42 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:42 devstack sudo[113930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275 Jun 24 16:18:42 devstack sudo[113930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:43 devstack sudo[113930]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-92fc2b4a-eeb2-4265-ba5d-59b224be1275" returned: 0 in 0.647s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-92fc2b4a-eeb2-4265-ba5d-59b224be1275" released by "delete_volume" :: held 1.420s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Created reservations ['466fdbea-27db-446f-8fd7-85976706c042', 'dd5dfa89-b768-492b-9360-3e434b89b240', 'cde06966-6dde-426c-be8a-6fa2ef0b6af0', 'cd64454a-a4d8-4963-893e-0b29be236096'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:43 devstack sudo[113933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:43 devstack sudo[113933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-003f16e3-ab56-487f-831c-dcb97412bece-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-003f16e3-ab56-487f-831c-dcb97412bece-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:43 devstack sudo[113933]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.649s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:43 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:43 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Deleted volume successfully. Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "cinder-quobyte-003f16e3-ab56-487f-831c-dcb97412bece" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0d735b89-0bdb-466c-999c-145af17a2d58 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-92fc2b4a-eeb2-4265-ba5d-59b224be1275-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-003f16e3-ab56-487f-831c-dcb97412bece" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2141cf13-fa47-437b-ba4f-23e1bd43c997]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:44 devstack sudo[113937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece Jun 24 16:18:44 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:44 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece" returned: 0 in 0.725s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:44 devstack sudo[113942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece Jun 24 16:18:44 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:45 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-003f16e3-ab56-487f-831c-dcb97412bece" returned: 0 in 0.683s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-quobyte-003f16e3-ab56-487f-831c-dcb97412bece" released by "delete_volume" :: held 1.450s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Created reservations ['ac261b1c-cbab-407f-8127-4fd6451d6e7e', '0de4cd6e-db1e-45f8-bc4b-c23891b91a43', '9b5df4eb-0ca3-44cc-b294-545abcd9ea6d', 'b34e24ab-a873-4ed9-b59a-ace8d4f23174'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:45 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:18:45 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:46 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.679s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:46 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:18:46 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Deleted volume successfully. Jun 24 16:18:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-949c86c5-1e2f-4448-86c4-c5f23e3e9110 tempest-CreateVolumesFromImageTest-1554309131 None] Lock "cinder-003f16e3-ab56-487f-831c-dcb97412bece-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:18:55 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=49,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:18:56 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=47,cinder:UPDATE=74,cinder:INSERT=22,cinder:DELETE=7 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (754f7f43-2c2c-4fe2-a7c3-7f933bdb9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c71668-cbf6-47aa-8b8f-0ce8f4391e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c71668-cbf6-47aa-8b8f-0ce8f4391e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-111332334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3afae5-c6fe-4d63-9758-9d0ab52879a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:58Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e5770c-389f-483c-9fc2-6ba729d3e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e5770c-389f-483c-9fc2-6ba729d3e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d21298-ab98-4edb-95ae-3bb65b370582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d21298-ab98-4edb-95ae-3bb65b370582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3afae5-c6fe-4d63-9758-9d0ab52879a3', 'volume_name': 'volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c53a168-9527-423e-9745-187f2d710e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c53a168-9527-423e-9745-187f2d710e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b38286-4c16-45c9-814a-38d79d58b724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Volume ea3afae5-c6fe-4d63-9758-9d0ab52879a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3', 'volume_size': 1} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-111332334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3afae5-c6fe-4d63-9758-9d0ab52879a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:58Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Creating volume ea3afae5-c6fe-4d63-9758-9d0ab52879a3 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:18:58 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:58 devstack sudo[113989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 1073741824 Jun 24 16:18:58 devstack sudo[113989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (a6f96d05-2caf-4632-8788-f455df98701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2206ae-d0a1-4c4d-aac3-f4fd5df8b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2206ae-d0a1-4c4d-aac3-f4fd5df8b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001128670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecaee31-b06e-4178-b5d1-60226beda49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:58Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0b3827-5fff-4393-8e12-c4fadf483621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0b3827-5fff-4393-8e12-c4fadf483621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9950090-bf17-4993-9831-46c42f7a57f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9950090-bf17-4993-9831-46c42f7a57f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecaee31-b06e-4178-b5d1-60226beda49e', 'volume_name': 'volume-0ecaee31-b06e-4178-b5d1-60226beda49e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1115823-8aff-4d9d-9878-31db98cff855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1115823-8aff-4d9d-9878-31db98cff855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91102af2-8a94-465f-b57c-07e78f346775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume 0ecaee31-b06e-4178-b5d1-60226beda49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecaee31-b06e-4178-b5d1-60226beda49e', 'volume_size': 1} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (a09141a5-2574-4fb9-a98e-18d0d08ef5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b1ea40-184a-4648-bfa8-ce154f5cc4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b1ea40-184a-4648-bfa8-ce154f5cc4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436525612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d6f10a-4cfc-41c3-82ca-5d7c10e002cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:59Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbef1df-86a9-46b8-bf70-0e61a7041213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbef1df-86a9-46b8-bf70-0e61a7041213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:58 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daebcddc-efd3-469c-a509-35fa014f1960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daebcddc-efd3-469c-a509-35fa014f1960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d6f10a-4cfc-41c3-82ca-5d7c10e002cd', 'volume_name': 'volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2ccdea-db74-412b-9ccc-01620fc3dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2ccdea-db74-412b-9ccc-01620fc3dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af59af5c-33a3-4bea-b302-c25bd012000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Volume 33d6f10a-4cfc-41c3-82ca-5d7c10e002cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd', 'volume_size': 1} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (9ccec99e-ee32-431a-bf0e-a407b53d8d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb92870b-5980-44e7-a816-9519ab6ba12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb92870b-5980-44e7-a816-9519ab6ba12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1466345830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4adea1-63b0-4fa7-a091-1f37377ea882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:59Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2698f7-6137-45a7-97b3-d9d0edacf79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2698f7-6137-45a7-97b3-d9d0edacf79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203d6146-04ae-42d5-b213-fcdeb536e357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203d6146-04ae-42d5-b213-fcdeb536e357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4adea1-63b0-4fa7-a091-1f37377ea882', 'volume_name': 'volume-5d4adea1-63b0-4fa7-a091-1f37377ea882', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541dc7b0-4379-4c2c-9fde-abb3003a53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541dc7b0-4379-4c2c-9fde-abb3003a53ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979c6f2c-8f21-4501-aa0e-69d134dce949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:18:59 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Volume 5d4adea1-63b0-4fa7-a091-1f37377ea882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4adea1-63b0-4fa7-a091-1f37377ea882', 'volume_size': 1} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:18:59 devstack sudo[113989]: pam_unix(sudo:session): session closed for user root Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 1073741824" returned: 0 in 1.281s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:18:59 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 Jun 24 16:18:59 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (1b94f28b-3d56-4e6e-84a6-1a7be480acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:18:59 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83893ebc-5ef9-4ea4-b18d-34175a25d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83893ebc-5ef9-4ea4-b18d-34175a25d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431094815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:00Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41559f8-7bf0-4e6a-b928-69403d1f67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41559f8-7bf0-4e6a-b928-69403d1f67f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c452ce9c-079c-4b69-b48a-0c3206423dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c452ce9c-079c-4b69-b48a-0c3206423dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4', 'volume_name': 'volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff2325b-8d26-4499-bc2b-b7653d41c026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff2325b-8d26-4499-bc2b-b7653d41c026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0ab5c4-4ab7-4ed3-bce0-602c18b29a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Volume b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4', 'volume_size': 1} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (6445d612-49b0-443c-b456-8a4e404f6ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e76c2e-6411-4eac-9002-72064c1afc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e76c2e-6411-4eac-9002-72064c1afc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1039028343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76560873-b9b2-4d67-8fcc-8801753a005e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:00Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d82d263-4f20-4899-b97f-7c4c6b039ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d82d263-4f20-4899-b97f-7c4c6b039ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd605b5-34ce-4da7-912c-fe670b8ae444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd605b5-34ce-4da7-912c-fe670b8ae444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76560873-b9b2-4d67-8fcc-8801753a005e', 'volume_name': 'volume-76560873-b9b2-4d67-8fcc-8801753a005e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ea5655-88a2-4b8c-8797-e2aa0cd6e117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ea5655-88a2-4b8c-8797-e2aa0cd6e117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea3de71-79d6-4e45-a5f7-fffd843fdc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Volume 76560873-b9b2-4d67-8fcc-8801753a005e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76560873-b9b2-4d67-8fcc-8801753a005e', 'volume_size': 1} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:00 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3" returned: 0 in 1.023s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001128670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecaee31-b06e-4178-b5d1-60226beda49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:58Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Creating volume 0ecaee31-b06e-4178-b5d1-60226beda49e {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:00 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:00 devstack sudo[113998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e 1073741824 Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b38286-4c16-45c9-814a-38d79d58b724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935f8029-8920-4ca4-897e-9d2c3506e10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:00 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Volume volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 (ea3afae5-c6fe-4d63-9758-9d0ab52879a3): created successfully Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935f8029-8920-4ca4-897e-9d2c3506e10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:00 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (754f7f43-2c2c-4fe2-a7c3-7f933bdb9887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:00 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a9883f32-a1da-4c18-af30-1d531a00cc79 tempest-CreateVolumesFromImageTest-781898596 None] Created volume successfully. Jun 24 16:19:01 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e 1073741824" returned: 0 in 0.983s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:01 devstack sudo[114004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e Jun 24 16:19:01 devstack sudo[114004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:02 devstack sudo[114004]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e" returned: 0 in 0.777s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.562s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436525612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d6f10a-4cfc-41c3-82ca-5d7c10e002cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:59Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Creating volume 33d6f10a-4cfc-41c3-82ca-5d7c10e002cd {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:02 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91102af2-8a94-465f-b57c-07e78f346775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecaee31-b06e-4178-b5d1-60226beda49e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c54597-0cb8-47ca-a8dd-3b7b4cd6d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:02 devstack sudo[114008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd 1073741824 Jun 24 16:19:02 devstack sudo[114008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume volume-0ecaee31-b06e-4178-b5d1-60226beda49e (0ecaee31-b06e-4178-b5d1-60226beda49e): created successfully Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c54597-0cb8-47ca-a8dd-3b7b4cd6d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (a6f96d05-2caf-4632-8788-f455df98701e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:02 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-cefa5d49-d0f9-4f2f-847b-44c83c2a7a6b tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created volume successfully. Jun 24 16:19:03 devstack sudo[114008]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd 1073741824" returned: 0 in 1.218s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:03 devstack sudo[114049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd Jun 24 16:19:03 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Flow 'volume_create_manager' (815a1160-3642-4a8d-b24d-9147811641e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe91069f-39fc-4abc-82e3-05fb3715d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe91069f-39fc-4abc-82e3-05fb3715d741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f969d5-8834-47e0-8621-765a3fad9313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9041927e9d0e4f66b003072be47c2acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:04Z,use_quota=True,user_id='7f698470d0c0493e971143a61028ec01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27a1d467-fcc5-478e-a849-995683b220fb),volume_type_id=27a1d467-fcc5-478e-a849-995683b220fb)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14aff5c2-e039-48f3-b15f-9c8da719b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14aff5c2-e039-48f3-b15f-9c8da719b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b43ecc-92ea-4429-a4d0-745042c64c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (4ae950f5-21fa-42e4-b01a-a1af8460edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64f4d5a-5a62-42fb-9cf4-acd8044dd81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64f4d5a-5a62-42fb-9cf4-acd8044dd81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766565697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e347667e-3a85-4379-9b20-83d8a4a3dd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:04Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed150f13-cdae-4766-8101-69a63d431455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed150f13-cdae-4766-8101-69a63d431455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26f2a07-2c69-4d74-a029-194889f0d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26f2a07-2c69-4d74-a029-194889f0d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e347667e-3a85-4379-9b20-83d8a4a3dd89', 'volume_name': 'volume-e347667e-3a85-4379-9b20-83d8a4a3dd89', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0914d0c2-accf-4005-9ffa-af8ce80cbf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0914d0c2-accf-4005-9ffa-af8ce80cbf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f02a76-1b2c-40f3-b0e1-da275bdf6f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume e347667e-3a85-4379-9b20-83d8a4a3dd89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e347667e-3a85-4379-9b20-83d8a4a3dd89', 'volume_size': 1} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b43ecc-92ea-4429-a4d0-745042c64c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9f969d5-8834-47e0-8621-765a3fad9313', 'volume_name': 'volume-b9f969d5-8834-47e0-8621-765a3fad9313', 'volume_size': 1, 'image_id': '0d273284-d421-41e0-8c15-cc80b6913426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d273284-d421-41e0-8c15-cc80b6913426', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16051ce8c58f3d5a63895be307d2563d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9041927e9d0e4f66b003072be47c2acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa6e1673f81d71a20d95d742f94052c8bd3cf5282317095122f30cd32b74b44e8ee4be408b1dc97977e10d53d18069b5d2ab138a089655f669d8d0974c98beb8', 'id': '0d273284-d421-41e0-8c15-cc80b6913426', 'created_at': datetime.datetime(2026, 6, 24, 14, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 19, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d273284-d421-41e0-8c15-cc80b6913426/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab658697-4790-42a3-9fc0-f24c43d5659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab658697-4790-42a3-9fc0-f24c43d5659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a170fbf-a7ce-4f7d-b5ce-42f7937cb9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Volume b9f969d5-8834-47e0-8621-765a3fad9313: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9f969d5-8834-47e0-8621-765a3fad9313', 'volume_size': 1, 'image_id': '0d273284-d421-41e0-8c15-cc80b6913426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d273284-d421-41e0-8c15-cc80b6913426', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16051ce8c58f3d5a63895be307d2563d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9041927e9d0e4f66b003072be47c2acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa6e1673f81d71a20d95d742f94052c8bd3cf5282317095122f30cd32b74b44e8ee4be408b1dc97977e10d53d18069b5d2ab138a089655f669d8d0974c98beb8', 'id': '0d273284-d421-41e0-8c15-cc80b6913426', 'created_at': datetime.datetime(2026, 6, 24, 14, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 19, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d273284-d421-41e0-8c15-cc80b6913426/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 16:19:04 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Trying to clone b9f969d5-8834-47e0-8621-765a3fad9313 from image 0d273284-d421-41e0-8c15-cc80b6913426 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d273284-d421-41e0-8c15-cc80b6913426', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:19:05 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd" returned: 0 in 1.155s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.477s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1466345830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4adea1-63b0-4fa7-a091-1f37377ea882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:18:59Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Creating volume 5d4adea1-63b0-4fa7-a091-1f37377ea882 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:05 devstack sudo[114055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 1073741824 Jun 24 16:19:05 devstack sudo[114055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af59af5c-33a3-4bea-b302-c25bd012000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f80ef8-4dad-4eb1-b519-f06c1f7ab43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (2582b669-e3ac-476f-9903-2c286528da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4e7f19-1af6-485c-9e79-311df38f1420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Image download 0.00 MB at 0.00 MB/s Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Volume volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd (33d6f10a-4cfc-41c3-82ca-5d7c10e002cd): created successfully Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f80ef8-4dad-4eb1-b519-f06c1f7ab43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (a09141a5-2574-4fb9-a98e-18d0d08ef5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad4e7f19-1af6-485c-9e79-311df38f1420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747970862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:05Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd61bdc-bbe1-4ebb-a7e9-7fb7b1003384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd61bdc-bbe1-4ebb-a7e9-7fb7b1003384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0f06b3-f9e3-4064-b88e-ff5dd2cf1ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0f06b3-f9e3-4064-b88e-ff5dd2cf1ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040', 'volume_name': 'volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61f2d0b-c424-4d8c-b951-e18027705616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61f2d0b-c424-4d8c-b951-e18027705616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c45289-0805-4c81-9582-a8dc0d78edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume 01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040', 'volume_size': 1} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a9318010-4748-4ef8-8371-4434f9a054c5 tempest-CreateVolumesFromImageTest-781898596 None] Created volume successfully. Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba0349e-dae9-4b0b-b7c2-465bf9533bd5]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (93d9e5c3-cc5f-4dfa-8417-c66fd4a82c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26487a46-2c8f-43d7-bdc3-c364acd912fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26487a46-2c8f-43d7-bdc3-c364acd912fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609783837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34ac643-710b-4d6a-a31a-55509848b389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:05Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88fc8f6-24bc-4fe2-b899-65a80628ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88fc8f6-24bc-4fe2-b899-65a80628ef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b826a-3281-43c8-9a92-bf52724b55df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682b826a-3281-43c8-9a92-bf52724b55df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34ac643-710b-4d6a-a31a-55509848b389', 'volume_name': 'volume-c34ac643-710b-4d6a-a31a-55509848b389', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726bd672-a115-4a08-bec4-1e5d10c9650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726bd672-a115-4a08-bec4-1e5d10c9650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e9843d-0ba3-4ebb-885c-82d3639114f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume c34ac643-710b-4d6a-a31a-55509848b389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34ac643-710b-4d6a-a31a-55509848b389', 'volume_size': 1} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:05 devstack sudo[114059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD Jun 24 16:19:05 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (5da35913-1612-4378-819d-8c8d34059455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d1b39d-430d-4508-9325-e01badfcbae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d1b39d-430d-4508-9325-e01badfcbae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025366892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2df90c-803d-4240-8323-8490c55329a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:05Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41685c14-d8ab-4303-bbbd-23e7eda8eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41685c14-d8ab-4303-bbbd-23e7eda8eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778f8155-468e-41c5-90ed-ee8b27a94b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778f8155-468e-41c5-90ed-ee8b27a94b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2df90c-803d-4240-8323-8490c55329a7', 'volume_name': 'volume-0b2df90c-803d-4240-8323-8490c55329a7', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15c5ccf-2118-4242-9d80-ec6902755364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15c5ccf-2118-4242-9d80-ec6902755364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8b78a2-79b6-4fd2-91b3-827771e94e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume 0b2df90c-803d-4240-8323-8490c55329a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2df90c-803d-4240-8323-8490c55329a7', 'volume_size': 1} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (4221e010-e0f3-473e-b98d-673221c7a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aafa40-866e-41d3-8443-4229b2a86222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81aafa40-866e-41d3-8443-4229b2a86222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018321707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ad3b84-abe5-4032-a08c-ecf35c52099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:06Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83b4245-1562-4bc1-9d63-701ae4f941c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83b4245-1562-4bc1-9d63-701ae4f941c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666c9bda-f7e0-4875-9e9a-e264cdf8dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666c9bda-f7e0-4875-9e9a-e264cdf8dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ad3b84-abe5-4032-a08c-ecf35c52099a', 'volume_name': 'volume-47ad3b84-abe5-4032-a08c-ecf35c52099a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5637c72f-5283-43d8-bebd-7739a8f74361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:05 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5637c72f-5283-43d8-bebd-7739a8f74361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:06 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096f9c59-799e-44d0-908e-1ba98c5b0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:06 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume 47ad3b84-abe5-4032-a08c-ecf35c52099a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ad3b84-abe5-4032-a08c-ecf35c52099a', 'volume_size': 1} Jun 24 16:19:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:06 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD" returned: 0 in 0.980s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:06 devstack sudo[114055]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 1073741824" returned: 0 in 1.360s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:06 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:06 devstack sudo[114067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD Jun 24 16:19:06 devstack sudo[114067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:06 devstack sudo[114068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 Jun 24 16:19:06 devstack sudo[114068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:07 devstack sudo[114067]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD" returned: 1 in 0.911s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Temporary image 0d273284-d421-41e0-8c15-cc80b6913426 is fetched for user 7f698470d0c0493e971143a61028ec01. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e8e5ea-9b22-4945-a08f-006ee071aa29]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:07 devstack sudo[114068]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882" returned: 0 in 0.961s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] <== create_volume: return (2383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.229s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431094815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:00Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Creating volume b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:07 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979c6f2c-8f21-4501-aa0e-69d134dce949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4adea1-63b0-4fa7-a091-1f37377ea882', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73472283-3158-4a22-997b-bf02273c03cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:07 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD Jun 24 16:19:07 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:07 devstack sudo[114076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 1073741824 Jun 24 16:19:07 devstack sudo[114076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:07 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Volume volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 (5d4adea1-63b0-4fa7-a091-1f37377ea882): created successfully Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73472283-3158-4a22-997b-bf02273c03cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:07 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (9ccec99e-ee32-431a-bf0e-a407b53d8d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:07 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f28ea535-5e36-4616-9544-1d6263ad73c5 tempest-CreateVolumesFromImageTest-781898596 None] Created volume successfully. Jun 24 16:19:08 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:08 devstack sudo[114076]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 1073741824" returned: 0 in 1.014s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:08 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD Jun 24 16:19:08 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:08 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 Jun 24 16:19:08 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:09 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:09 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4" returned: 0 in 0.705s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.681s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1039028343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76560873-b9b2-4d67-8fcc-8801753a005e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1159f30e89d48b78dad47bb7017fbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:00Z,use_quota=True,user_id='cfbeaf2343a84c56a9c96b72e2d7ad97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Creating volume 76560873-b9b2-4d67-8fcc-8801753a005e {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:09 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0ab5c4-4ab7-4ed3-bce0-602c18b29a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:09 devstack sudo[114093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e 1073741824 Jun 24 16:19:09 devstack sudo[114093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff419b4-d670-4505-836c-56d6c7a3c024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:09 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Volume volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 (b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4): created successfully Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff419b4-d670-4505-836c-56d6c7a3c024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (1b94f28b-3d56-4e6e-84a6-1a7be480acd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8cb4d131-b155-452d-b718-de5dcea86c20 tempest-CreateVolumesFromImageTest-781898596 None] Created volume successfully. Jun 24 16:19:10 devstack sudo[114093]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e 1073741824" returned: 0 in 1.005s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:10 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e Jun 24 16:19:10 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:10 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e" returned: 0 in 0.677s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.278s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766565697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e347667e-3a85-4379-9b20-83d8a4a3dd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:04Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Creating volume e347667e-3a85-4379-9b20-83d8a4a3dd89 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:10 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:10 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 1073741824 Jun 24 16:19:10 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:10 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea3de71-79d6-4e45-a5f7-fffd843fdc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76560873-b9b2-4d67-8fcc-8801753a005e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a05e29b-3ee3-43f6-aa2a-b23deb2e2134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:11 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Volume volume-76560873-b9b2-4d67-8fcc-8801753a005e (76560873-b9b2-4d67-8fcc-8801753a005e): created successfully Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a05e29b-3ee3-43f6-aa2a-b23deb2e2134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Flow 'volume_create_manager' (6445d612-49b0-443c-b456-8a4e404f6ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:11 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-3b95db3c-f0b7-491d-a53f-9ca1ae8c8ab8 tempest-CreateVolumesFromImageTest-781898596 None] Created volume successfully. Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-76560873-b9b2-4d67-8fcc-8801753a005e-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-76560873-b9b2-4d67-8fcc-8801753a005e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-quobyte-76560873-b9b2-4d67-8fcc-8801753a005e" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-76560873-b9b2-4d67-8fcc-8801753a005e" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263ae20-96c5-4f4f-9e7e-8ee1c174a23f]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:11 devstack sudo[114108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e Jun 24 16:19:11 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:11 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 1073741824" returned: 0 in 1.029s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:12 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 Jun 24 16:19:12 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:12 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e" returned: 0 in 0.896s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:12 devstack sudo[114117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e Jun 24 16:19:12 devstack sudo[114117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:12 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89" returned: 0 in 0.760s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.493s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747970862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:05Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Creating volume 01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:12 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f02a76-1b2c-40f3-b0e1-da275bdf6f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e347667e-3a85-4379-9b20-83d8a4a3dd89', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:12 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 1073741824 Jun 24 16:19:12 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712ca9b9-f025-453b-9de6-82ea63d0638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 (e347667e-3a85-4379-9b20-83d8a4a3dd89): created successfully Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712ca9b9-f025-453b-9de6-82ea63d0638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (4ae950f5-21fa-42e4-b01a-a1af8460edba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:12 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-40f49fae-ea37-41aa-bfe0-da2110105d74 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created volume successfully. Jun 24 16:19:13 devstack sudo[114117]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-76560873-b9b2-4d67-8fcc-8801753a005e" returned: 0 in 0.806s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-76560873-b9b2-4d67-8fcc-8801753a005e" released by "delete_volume" :: held 1.746s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Created reservations ['abc37370-9e80-4031-bc2e-06b0ce0dede8', 'a17514a3-05dd-4c28-955c-880ca3bdb13f', '61f81ee1-fdda-4a8d-a6ac-344dd581c63c', 'fa5d9af5-231a-4fd5-85ec-7a61b06ee000'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:13 devstack sudo[114127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:13 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:13 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 1073741824" returned: 0 in 0.972s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:13 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 Jun 24 16:19:13 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-quobyte-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9774d1d-0c85-4391-a4d9-5833d2947162]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:14 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 Jun 24 16:19:14 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:14 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.760s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Deleted volume successfully. Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e9d27055-f8f8-41aa-82e9-97425d30deda tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-76560873-b9b2-4d67-8fcc-8801753a005e-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:14 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040" returned: 0 in 0.841s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.096s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609783837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34ac643-710b-4d6a-a31a-55509848b389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:05Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Creating volume c34ac643-710b-4d6a-a31a-55509848b389 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:14 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c45289-0805-4c81-9582-a8dc0d78edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f198837-15a1-414f-b48b-027ebe581369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:14 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 1073741824 Jun 24 16:19:14 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:14 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 (01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040): created successfully Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f198837-15a1-414f-b48b-027ebe581369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (2582b669-e3ac-476f-9903-2c286528da32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-32b80404-f308-4718-8ef1-f52cfc35cc22 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created volume successfully. Jun 24 16:19:14 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4" returned: 0 in 0.935s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:14 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4 Jun 24 16:19:14 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:15 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 1073741824" returned: 0 in 0.975s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:15 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:15 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 Jun 24 16:19:15 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:15 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4" released by "delete_volume" :: held 1.815s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:15 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Created reservations ['3a2df97f-f0ba-4a3f-871e-ac8f71b83e0e', '2493b069-2bb6-4c33-b392-c0239552b5dc', '950c064b-edce-4787-a1c3-38eabb9d712d', '482ac119-aaf9-4a01-b178-a8805f3cfdb1'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:16 devstack sudo[114150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:16 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-5d4adea1-63b0-4fa7-a091-1f37377ea882-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-5d4adea1-63b0-4fa7-a091-1f37377ea882-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-quobyte-5d4adea1-63b0-4fa7-a091-1f37377ea882" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-5d4adea1-63b0-4fa7-a091-1f37377ea882" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc152768-fc9a-4bdf-8259-701c0b742d7b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:16 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 Jun 24 16:19:16 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:16 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389" returned: 0 in 1.019s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.076s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025366892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2df90c-803d-4240-8323-8490c55329a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:05Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Creating volume 0b2df90c-803d-4240-8323-8490c55329a7 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:16 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e9843d-0ba3-4ebb-885c-82d3639114f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34ac643-710b-4d6a-a31a-55509848b389', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:16 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 1073741824 Jun 24 16:19:16 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00066a4-b030-40ad-9532-4b69909b7d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:16 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume volume-c34ac643-710b-4d6a-a31a-55509848b389 (c34ac643-710b-4d6a-a31a-55509848b389): created successfully Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00066a4-b030-40ad-9532-4b69909b7d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (93d9e5c3-cc5f-4dfa-8417-c66fd4a82c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-fa85b9b6-6256-4cf3-9c62-445aa237f5b1 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created volume successfully. Jun 24 16:19:17 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.916s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Deleted volume successfully. Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-781c48f4-9067-47af-9113-8ea97adf3f3b tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-b5b0e474-5c8a-4f17-9f91-7c6dd36c82b4-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:17 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882" returned: 0 in 0.977s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:17 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882 Jun 24 16:19:17 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:17 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 1073741824" returned: 0 in 1.024s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:17 devstack sudo[114167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 Jun 24 16:19:17 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:18 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-5d4adea1-63b0-4fa7-a091-1f37377ea882" returned: 0 in 0.720s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-5d4adea1-63b0-4fa7-a091-1f37377ea882" released by "delete_volume" :: held 1.766s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Created reservations ['adc3278a-a9d0-4075-b0b5-5b52bbe8f1ef', '6aae127b-6451-483d-90e4-b432378d411b', 'd7353c98-48aa-4540-b043-2fd9cb01eadc', '79173b6a-d8fe-4f2b-9ce2-2dd65e4fbbc0'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:18 devstack sudo[114170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:18 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-quobyte-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd" acquired by "delete_volume" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56b93f-ab3e-46a1-a681-de4617947718]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:18 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7" returned: 0 in 0.871s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.759s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018321707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ad3b84-abe5-4032-a08c-ecf35c52099a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f99d0beafe343b4a1bd7a6c9f7dde9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:06Z,use_quota=True,user_id='977d5acac1164686ae0328530d40179b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Creating volume 47ad3b84-abe5-4032-a08c-ecf35c52099a {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:18 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8b78a2-79b6-4fd2-91b3-827771e94e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2df90c-803d-4240-8323-8490c55329a7', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:18 devstack sudo[114174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a 1073741824 Jun 24 16:19:18 devstack sudo[114174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:18 devstack sudo[114173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ab545c-b0ea-4916-ba01-e055f6f4c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:18 devstack sudo[114173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:18 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume volume-0b2df90c-803d-4240-8323-8490c55329a7 (0b2df90c-803d-4240-8323-8490c55329a7): created successfully Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ab545c-b0ea-4916-ba01-e055f6f4c221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:18 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (5da35913-1612-4378-819d-8c8d34059455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:18 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ef121af4-b531-4887-8a92-afd7eb09fc3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created volume successfully. Jun 24 16:19:19 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.950s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:19 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Deleted volume successfully. Jun 24 16:19:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f58b0eca-3a16-4417-b751-67324449e6ac tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-5d4adea1-63b0-4fa7-a091-1f37377ea882-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:19 devstack sudo[114173]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd" returned: 0 in 0.875s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:19 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd Jun 24 16:19:19 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:19 devstack sudo[114174]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a 1073741824" returned: 0 in 1.179s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:20 devstack sudo[114188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a Jun 24 16:19:20 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:20 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd" returned: 0 in 0.744s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd" released by "delete_volume" :: held 1.673s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Created reservations ['98e800a0-f867-4c3c-91a3-633ef6d01a10', 'fc87b22b-913f-4dae-9a41-dbf52a7dbb38', 'c838ef35-42b6-49e6-be0f-92b8437a1408', '81bc6a7a-f0fb-41a0-8d95-2e1aab774c0c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:20 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:20 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:20 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a" returned: 0 in 0.699s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.585s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f969d5-8834-47e0-8621-765a3fad9313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9041927e9d0e4f66b003072be47c2acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:04Z,use_quota=True,user_id='7f698470d0c0493e971143a61028ec01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27a1d467-fcc5-478e-a849-995683b220fb),volume_type_id=27a1d467-fcc5-478e-a849-995683b220fb)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Creating volume b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:20 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096f9c59-799e-44d0-908e-1ba98c5b0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ad3b84-abe5-4032-a08c-ecf35c52099a', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa9f01b-f8af-4e78-8993-f086d3909c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:20 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 1073741824 Jun 24 16:19:20 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:20 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Volume volume-47ad3b84-abe5-4032-a08c-ecf35c52099a (47ad3b84-abe5-4032-a08c-ecf35c52099a): created successfully Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa9f01b-f8af-4e78-8993-f086d3909c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Flow 'volume_create_manager' (4221e010-e0f3-473e-b98d-673221c7a75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:20 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1f8ff17d-181c-4126-9470-e0d474cab829 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created volume successfully. Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-ea3afae5-c6fe-4d63-9758-9d0ab52879a3-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-ea3afae5-c6fe-4d63-9758-9d0ab52879a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "cinder-quobyte-ea3afae5-c6fe-4d63-9758-9d0ab52879a3" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-ea3afae5-c6fe-4d63-9758-9d0ab52879a3" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad9d422-c8bb-4395-88ac-4e4c86d3449d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:21 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 Jun 24 16:19:21 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:21 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.814s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Deleted volume successfully. Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-676efb4f-870f-4f55-ae28-58808813801a tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-33d6f10a-4cfc-41c3-82ca-5d7c10e002cd-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-47ad3b84-abe5-4032-a08c-ecf35c52099a-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-47ad3b84-abe5-4032-a08c-ecf35c52099a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-quobyte-47ad3b84-abe5-4032-a08c-ecf35c52099a" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-47ad3b84-abe5-4032-a08c-ecf35c52099a" acquired by "delete_volume" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee8be4a-8757-4adf-83f9-475ff1bbdc77]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:21 devstack sudo[114203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a Jun 24 16:19:21 devstack sudo[114203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:21 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 1073741824" returned: 0 in 1.236s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:22 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3" returned: 0 in 1.040s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:22 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3 Jun 24 16:19:22 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:22 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:22 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:22 devstack sudo[114203]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a" returned: 0 in 0.941s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:22 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a Jun 24 16:19:22 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:22 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-ea3afae5-c6fe-4d63-9758-9d0ab52879a3" returned: 0 in 0.778s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-quobyte-ea3afae5-c6fe-4d63-9758-9d0ab52879a3" released by "delete_volume" :: held 1.863s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Created reservations ['2ae60623-38ee-462c-88bb-21a138aab7ea', 'b39702e9-a135-4ef8-aba5-3874f7ab9b52', '0a061e53-62fd-48ab-b94f-81e6cefe58bf', '1e23850d-3568-4524-8a1f-8c0b7deb685a'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:22 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 0 in 0.847s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Attempting download of 0d273284-d421-41e0-8c15-cc80b6913426 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d273284-d421-41e0-8c15-cc80b6913426', 'metadata': {}}])) to volume b9f969d5-8834-47e0-8621-765a3fad9313. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2180e1df-b41c-4784-a765-773a6b0baeb1]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:23 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:23 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:23 devstack sudo[114221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe Jun 24 16:19:23 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:23 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-47ad3b84-abe5-4032-a08c-ecf35c52099a" returned: 0 in 1.090s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-47ad3b84-abe5-4032-a08c-ecf35c52099a" released by "delete_volume" :: held 2.101s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created reservations ['c13670db-166b-458e-b32f-75a4013223de', '3d5dbf73-3732-43d2-b64a-df2caba27ef1', '45a16391-8958-40fe-adda-6487281bd90a', '4ecc911c-2c97-482e-88d6-4a2d70b2b550'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:24 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:24 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:24 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.052s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Deleted volume successfully. Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d5dcfd41-6eac-4257-9c2b-53cb5ab13134 tempest-CreateVolumesFromImageTest-781898596 None] Lock "cinder-ea3afae5-c6fe-4d63-9758-9d0ab52879a3-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:24 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe" returned: 0 in 1.222s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:24 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe Jun 24 16:19:24 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:24 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.875s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Deleted volume successfully. Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-11714039-8c9c-45ee-bc55-db952af06d14 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-47ad3b84-abe5-4032-a08c-ecf35c52099a-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-0b2df90c-803d-4240-8323-8490c55329a7-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-0b2df90c-803d-4240-8323-8490c55329a7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-quobyte-0b2df90c-803d-4240-8323-8490c55329a7" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-0b2df90c-803d-4240-8323-8490c55329a7" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b9199-9314-40b6-a09a-ce0e91762cd1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Flow 'volume_create_manager' (e3ebf45a-4701-48fb-aadb-d4b8900ad18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5d6840-ea95-4b1b-8036-b35d7fe3bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:25 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 Jun 24 16:19:25 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5d6840-ea95-4b1b-8036-b35d7fe3bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1923194687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f404e27b-2380-4d1f-8885-1fbdd04edb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d4e9b2bc554dbe96c05a2959acaaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:25Z,use_quota=True,user_id='bdc821650a4846b3b569e8f34da700bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74236895-13c3-4605-9de7-cf9420e2d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:25 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74236895-13c3-4605-9de7-cf9420e2d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1faaf5-9c49-4d9c-a217-4079c26602b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1faaf5-9c49-4d9c-a217-4079c26602b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f404e27b-2380-4d1f-8885-1fbdd04edb90', 'volume_name': 'volume-f404e27b-2380-4d1f-8885-1fbdd04edb90', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28e0cc4-4390-44ea-8cc6-5e8e74eef0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28e0cc4-4390-44ea-8cc6-5e8e74eef0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1123af0a-7f69-4376-8606-da120fdfe82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:25 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Volume f404e27b-2380-4d1f-8885-1fbdd04edb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f404e27b-2380-4d1f-8885-1fbdd04edb90', 'volume_size': 1} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1923194687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f404e27b-2380-4d1f-8885-1fbdd04edb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d4e9b2bc554dbe96c05a2959acaaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:25Z,use_quota=True,user_id='bdc821650a4846b3b569e8f34da700bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Creating volume f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:25 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe" returned: 1 in 1.063s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d273284-d421-41e0-8c15-cc80b6913426_mywbekwe' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[688a5df1-d363-4ee9-bef6-563a5be48eef]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:25 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 1073741824 Jun 24 16:19:25 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:25 devstack sudo[114238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD Jun 24 16:19:25 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:26 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7" returned: 0 in 0.953s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:26 devstack sudo[114249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7 Jun 24 16:19:26 devstack sudo[114249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:26 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:26 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 1073741824" returned: 0 in 0.925s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:26 devstack sudo[114254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:26 devstack sudo[114254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:26 devstack sudo[114253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD Jun 24 16:19:26 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:26 devstack sudo[114249]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0b2df90c-803d-4240-8323-8490c55329a7" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-0b2df90c-803d-4240-8323-8490c55329a7" released by "delete_volume" :: held 1.775s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created reservations ['ae1d343e-e71d-4e08-af6c-dbd7126eac85', '4c325416-67cc-47f1-8668-34494d63b86a', '8b6edcb1-8cce-489c-bb97-ca9e21ef264b', 'db6bd8eb-a907-4457-9d2f-21b59a165fdb'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:27 devstack sudo[114259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:27 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:27 devstack sudo[114254]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 0.722s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1123af0a-7f69-4376-8606-da120fdfe82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f404e27b-2380-4d1f-8885-1fbdd04edb90', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a20f99-11c5-4716-893e-812ddaa10a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:27 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Volume volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 (f404e27b-2380-4d1f-8885-1fbdd04edb90): created successfully Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a20f99-11c5-4716-893e-812ddaa10a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Flow 'volume_create_manager' (e3ebf45a-4701-48fb-aadb-d4b8900ad18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:27 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-3ab9138d-b4df-4eed-8d27-488c9998f081 tempest-SnapshotDependencyTests-1814424047 None] Created volume successfully. Jun 24 16:19:27 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD" returned: 1 in 0.989s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] 0d273284-d421-41e0-8c15-cc80b6913426 was raw, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-c34ac643-710b-4d6a-a31a-55509848b389-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:27 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:27 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-c34ac643-710b-4d6a-a31a-55509848b389-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-quobyte-c34ac643-710b-4d6a-a31a-55509848b389" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-c34ac643-710b-4d6a-a31a-55509848b389" acquired by "delete_volume" :: waited 0.029s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089abe9-ef90-495c-bb6d-aed7ccf20c4a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:27 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:27 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Creating offline snapshot a3399590-017a-44be-817d-e6d9d2abc120 of volume f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b3f26-bd15-42be-876d-c999a9650cc1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:27 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.868s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:27 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Deleted volume successfully. Jun 24 16:19:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-12ed2655-cfd6-4674-b680-5a01f15add88 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-0b2df90c-803d-4240-8323-8490c55329a7-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:27 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:27 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:28 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 0 in 1.044s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d273284-d421-41e0-8c15-cc80b6913426_4jeaa7hpdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:19:28 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:28 devstack sudo[114278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 1G Jun 24 16:19:28 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:28 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389" returned: 0 in 0.934s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:28 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389 Jun 24 16:19:28 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:28 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 0.865s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:28 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 1G Jun 24 16:19:28 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:29 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 1G" returned: 0 in 0.829s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56b69f5-92cd-4069-9db7-877d28c6758a]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:29 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c34ac643-710b-4d6a-a31a-55509848b389" returned: 0 in 0.830s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-c34ac643-710b-4d6a-a31a-55509848b389" released by "delete_volume" :: held 1.826s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created reservations ['fb1f42cc-8e01-4180-849a-bd4fb068199f', '79e3aa12-56b6-460f-9926-9005e77daba5', '0e646ada-af8f-436e-9856-a1b9a9ede4e8', '22834cb8-faa5-4197-b2d5-465bcdb76d3e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:29 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:29 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:29 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:29 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:29 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 1G" returned: 0 in 1.013s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:29 devstack sudo[114301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 Jun 24 16:19:29 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-quobyte-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040" acquired by "delete_volume" :: waited 0.016s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbc7650-b7ba-4dec-8773-13ff0e1c7eab]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:30 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 Jun 24 16:19:30 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:30 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.874s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Deleted volume successfully. Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-0cc9a845-0585-47e2-b2ab-64e910670094 tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-c34ac643-710b-4d6a-a31a-55509848b389-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:30 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 0 in 1.192s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:30 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:30 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:30 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120" returned: 0 in 1.025s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:30 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 is being set with open permissions: ugo+rw Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:30 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 Jun 24 16:19:30 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:30 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040" returned: 0 in 0.923s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:30 devstack sudo[114318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040 Jun 24 16:19:30 devstack sudo[114318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Flow 'volume_create_manager' (d866387f-4038-4143-87bd-6081d2682a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c3e9f8-7b43-4ffb-948e-025bcacf0e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c3e9f8-7b43-4ffb-948e-025bcacf0e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865669a7-ac4b-4947-a0b7-d1e1c572d220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0110dcaf8254cb985672e5bb6b351c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:31Z,use_quota=True,user_id='2743869721c54236858facde455deda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccc2f55-cef3-4e36-a66c-453d6a04b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccc2f55-cef3-4e36-a66c-453d6a04b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565862b8-f841-4aac-85b1-3cdb59030d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:30 devstack cinder-volume[93867]: DEBUG cinder.image.glance [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Creating Keystone auth plugin from conf {{(pid=93867) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565862b8-f841-4aac-85b1-3cdb59030d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '865669a7-ac4b-4947-a0b7-d1e1c572d220', 'volume_name': 'volume-865669a7-ac4b-4947-a0b7-d1e1c572d220', 'volume_size': 1, 'image_id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b98106b89bcd8fbac1b33e0fbc7b0bb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0110dcaf8254cb985672e5bb6b351c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5f623580bfba68fef6f0f6c618f0b7ea14b38ff06347a31daac72ffccba85758893c2a7e8d7e8a21a46e4df4afc75d0839de26d6d96503b75a3e373040fe3697', 'id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'created_at': datetime.datetime(2026, 6, 24, 14, 19, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 19, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b/file', 'properties': {}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2690bda5-40b7-48bf-8043-6a2af4f115f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2690bda5-40b7-48bf-8043-6a2af4f115f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41219452-a804-4c33-9af7-9589f37d6ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Volume 865669a7-ac4b-4947-a0b7-d1e1c572d220: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-865669a7-ac4b-4947-a0b7-d1e1c572d220', 'volume_size': 1, 'image_id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b98106b89bcd8fbac1b33e0fbc7b0bb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0110dcaf8254cb985672e5bb6b351c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5f623580bfba68fef6f0f6c618f0b7ea14b38ff06347a31daac72ffccba85758893c2a7e8d7e8a21a46e4df4afc75d0839de26d6d96503b75a3e373040fe3697', 'id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'created_at': datetime.datetime(2026, 6, 24, 14, 19, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 19, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b/file', 'properties': {}}, 'image_service': } Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Trying to clone 865669a7-ac4b-4947-a0b7-d1e1c572d220 from image cde99ab9-92fa-4d09-8fd0-d1083d047d8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'metadata': {}}]). {{(pid=93867) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 16:19:31 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Image download 0.00 MB at 0.00 MB/s Jun 24 16:19:31 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 1 in 0.958s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Downloaded image 0d273284-d421-41e0-8c15-cc80b6913426 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d273284-d421-41e0-8c15-cc80b6913426', 'metadata': {}}])) to volume b9f969d5-8834-47e0-8621-765a3fad9313 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Temporary image 0d273284-d421-41e0-8c15-cc80b6913426 for user 7f698470d0c0493e971143a61028ec01 is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Marking volume b9f969d5-8834-47e0-8621-765a3fad9313 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[40abcec9-afe5-49a0-89ab-2b5f48a68074]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Copying metadata from image 0d273284-d421-41e0-8c15-cc80b6913426 to b9f969d5-8834-47e0-8621-765a3fad9313. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Creating volume glance metadata for volume b9f969d5-8834-47e0-8621-765a3fad9313 backed by image 0d273284-d421-41e0-8c15-cc80b6913426 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0d273284-d421-41e0-8c15-cc80b6913426', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '16051ce8c58f3d5a63895be307d2563d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a170fbf-a7ce-4f7d-b5ce-42f7937cb9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f969d5-8834-47e0-8621-765a3fad9313', 'volume_size': 1, 'image_id': '0d273284-d421-41e0-8c15-cc80b6913426', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d273284-d421-41e0-8c15-cc80b6913426', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16051ce8c58f3d5a63895be307d2563d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9041927e9d0e4f66b003072be47c2acf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa6e1673f81d71a20d95d742f94052c8bd3cf5282317095122f30cd32b74b44e8ee4be408b1dc97977e10d53d18069b5d2ab138a089655f669d8d0974c98beb8', 'id': '0d273284-d421-41e0-8c15-cc80b6913426', 'created_at': datetime.datetime(2026, 6, 24, 14, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 19, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d273284-d421-41e0-8c15-cc80b6913426/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9557c0-0d75-4f2b-8920-953e75a0a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:31 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120" returned: 0 in 0.824s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:31 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Volume volume-b9f969d5-8834-47e0-8621-765a3fad9313 (b9f969d5-8834-47e0-8621-765a3fad9313): created successfully Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9557c0-0d75-4f2b-8920-953e75a0a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Flow 'volume_create_manager' (815a1160-3642-4a8d-b24d-9147811641e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:31 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD Jun 24 16:19:31 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:31 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6e86c156-c87f-462a-8fe4-f37851389987 tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Created volume successfully. Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:31 devstack sudo[114327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info Jun 24 16:19:31 devstack sudo[114327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:31 devstack sudo[114318]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040" returned: 0 in 0.813s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040" released by "delete_volume" :: held 1.810s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created reservations ['78e5c94e-eba5-4c64-8e4c-32069cb1b48f', 'd7147df1-ad23-4783-9629-b7bf284e3540', 'd7441200-f4d0-4068-b51f-76bfa6c3b270', '0f1d83be-d526-4232-bb64-4067fa2aa855'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:31 devstack sudo[114335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:31 devstack sudo[114335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-e347667e-3a85-4379-9b20-83d8a4a3dd89-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-e347667e-3a85-4379-9b20-83d8a4a3dd89-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-quobyte-e347667e-3a85-4379-9b20-83d8a4a3dd89" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-e347667e-3a85-4379-9b20-83d8a4a3dd89" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ea676-d9ab-4c3c-ab15-be68da9024ee]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Acquiring lock "cinder-b9f969d5-8834-47e0-8621-765a3fad9313-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "cinder-b9f969d5-8834-47e0-8621-765a3fad9313-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:32 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Acquiring lock "cinder-quobyte-b9f969d5-8834-47e0-8621-765a3fad9313" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:32 devstack sudo[114327]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info" returned: 0 in 0.785s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:32 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info is being set with open permissions: ugo+rw Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:32 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 Jun 24 16:19:32 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "cinder-quobyte-b9f969d5-8834-47e0-8621-765a3fad9313" acquired by "delete_volume" :: waited 0.053s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:32 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info Jun 24 16:19:32 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[305dce19-5789-4150-8024-0962ea604ab9]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:32 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD Jun 24 16:19:32 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:32 devstack sudo[114345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:32 devstack sudo[114345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:32 devstack sudo[114335]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.187s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:32 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:32 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Deleted volume successfully. Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-200919f2-bf1a-49fb-9f35-712dff48c8ff tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-01ae9ec6-bb34-4a68-a4f3-0d1deb9f4040-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:33 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.info" returned: 0 in 0.721s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.403s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-091970da-b1c2-4116-9ce6-02763ea63b7d tempest-SnapshotDependencyTests-1814424047 None] Create snapshot completed successfully Jun 24 16:19:33 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89" returned: 0 in 1.001s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:33 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89 Jun 24 16:19:33 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:33 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD" returned: 1 in 0.879s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Temporary image cde99ab9-92fa-4d09-8fd0-d1083d047d8b is fetched for user 2743869721c54236858facde455deda9. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc88c9-d1dd-475d-845b-0026712dc870]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:33 devstack sudo[114359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD Jun 24 16:19:33 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:33 devstack sudo[114345]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 0 in 1.152s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:33 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:33 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:33 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e347667e-3a85-4379-9b20-83d8a4a3dd89" returned: 0 in 0.685s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-e347667e-3a85-4379-9b20-83d8a4a3dd89" released by "delete_volume" :: held 1.748s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:33 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created reservations ['0d87def3-aca9-4f0d-9645-e057b8fefb7c', '2b5ac214-6d1c-4aed-8148-e8f51532a7a4', 'e49b63fd-2b50-41e3-8ff1-90fd8ef4ba40', '93f3a6bb-15db-4f49-9297-d69b89d2dbae'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:34 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:34 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:34 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:34 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD Jun 24 16:19:34 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-0ecaee31-b06e-4178-b5d1-60226beda49e-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-0ecaee31-b06e-4178-b5d1-60226beda49e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "cinder-quobyte-0ecaee31-b06e-4178-b5d1-60226beda49e" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-0ecaee31-b06e-4178-b5d1-60226beda49e" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a3c77d-b9a9-4e12-a42d-76d604c217f0]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:34 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 1 in 0.997s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:34 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313 Jun 24 16:19:34 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:34 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e Jun 24 16:19:34 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Flow 'volume_create_manager' (dcfc5047-f979-4457-9ce0-52bd63bb15bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ced703-346e-4773-b16f-ab6f02b46ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ced703-346e-4773-b16f-ab6f02b46ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790d0059-c58f-46c4-9aaa-c0a568a84b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d4e9b2bc554dbe96c05a2959acaaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3399590-017a-44be-817d-e6d9d2abc120,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:35Z,use_quota=True,user_id='bdc821650a4846b3b569e8f34da700bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:34 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:34 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da56ba9-2c23-412d-8ff4-8c2ccd148874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da56ba9-2c23-412d-8ff4-8c2ccd148874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffee6a5b-e2e5-4cc2-a87a-10d0d2dff645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffee6a5b-e2e5-4cc2-a87a-10d0d2dff645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '790d0059-c58f-46c4-9aaa-c0a568a84b54', 'volume_name': 'volume-790d0059-c58f-46c4-9aaa-c0a568a84b54', 'volume_size': 1, 'snapshot_id': 'a3399590-017a-44be-817d-e6d9d2abc120'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff61730d-09a7-46e1-950d-c4252193bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff61730d-09a7-46e1-950d-c4252193bf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f06eda-bdc7-4d2d-8e26-5f67a32c9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:35 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Volume 790d0059-c58f-46c4-9aaa-c0a568a84b54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-790d0059-c58f-46c4-9aaa-c0a568a84b54', 'volume_size': 1, 'snapshot_id': 'a3399590-017a-44be-817d-e6d9d2abc120'} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 1.003s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-quobyte-a3399590-017a-44be-817d-e6d9d2abc120-790d0059-c58f-46c4-9aaa-c0a568a84b54" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Deleted volume successfully. Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-a3399590-017a-44be-817d-e6d9d2abc120-790d0059-c58f-46c4-9aaa-c0a568a84b54" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Creating volume 790d0059-c58f-46c4-9aaa-c0a568a84b54 from snapshot a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-quobyte-790d0059-c58f-46c4-9aaa-c0a568a84b54" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-709b3cb5-a3bd-48f6-ab53-e4f66fcf6f3f tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-e347667e-3a85-4379-9b20-83d8a4a3dd89-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-790d0059-c58f-46c4-9aaa-c0a568a84b54" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] snapshot: a3399590-017a-44be-817d-e6d9d2abc120, volume: 790d0059-c58f-46c4-9aaa-c0a568a84b54, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b970766-357f-4d59-9693-cc72ccdbcebb]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:35 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD" returned: 1 in 1.150s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:35 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 Jun 24 16:19:35 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:35 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-b9f969d5-8834-47e0-8621-765a3fad9313" returned: 0 in 0.837s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:35 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "cinder-quobyte-b9f969d5-8834-47e0-8621-765a3fad9313" released by "delete_volume" :: held 3.094s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e" returned: 0 in 0.967s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:35 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e Jun 24 16:19:35 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Created reservations ['1cd8e11f-8fac-4203-b285-9ff3c6041714', '8a9247b7-8c24-4976-b32c-eddce3a3ef66', '8ab56325-c450-4cf4-9d32-2bd34afec9c7', '4505e480-778e-4058-afaa-4d04780a9066'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:35 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:35 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:35 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f404e27b-2380-4d1f-8885-1fbdd04edb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:19:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[8682b321-832a-4d7e-b98a-66b9ef398e07]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:36 devstack sudo[114397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:36 devstack sudo[114397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:36 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-0ecaee31-b06e-4178-b5d1-60226beda49e" returned: 0 in 0.714s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-quobyte-0ecaee31-b06e-4178-b5d1-60226beda49e" released by "delete_volume" :: held 1.740s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Created reservations ['1b162c52-0fc9-4c87-919b-9d36b62a2d11', 'eac7ae3e-539f-4235-96ad-7a6d67a5e19b', '212069ec-550a-47b6-9f4b-bcfe1e940502', '0da3e65d-fabd-4e02-ba5f-255aa614c7d9'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:36 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.741s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:36 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Deleted volume successfully. Jun 24 16:19:36 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:36 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-865e4047-65db-43a7-8970-60ef3b31f87b tempest-VolumeAndVolumeTypeFromImageTest-771200415 None] Lock "cinder-b9f969d5-8834-47e0-8621-765a3fad9313-delete_volume" released by "delete_volume" :: held 4.132s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:36 devstack sudo[114397]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 0.820s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:19:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:36 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 Jun 24 16:19:36 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:37 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.820s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:37 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Deleted volume successfully. Jun 24 16:19:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-4293e5d4-3a06-4cc6-8f4e-d8a62828c16d tempest-CreateVolumesFromSourceVolumeTest-205446972 None] Lock "cinder-0ecaee31-b06e-4178-b5d1-60226beda49e-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:39 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:39 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:41 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:41 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 2.039s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:41 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:41 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:19:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:19:41 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:19:43 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54" returned: 0 in 6.458s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d7a575-7e90-4a1c-8327-295b151fb624]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:43 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:43 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Flow 'volume_create_manager' (6588906b-f6be-45fd-b73b-c38be21e2ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1089347f-c66c-4308-afdc-c2d9652c3bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1089347f-c66c-4308-afdc-c2d9652c3bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540984645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e396c4b7-6d5b-499a-9602-0a3dddfeec69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359ce0dffc354d3d852bb4fe51aec563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:44Z,use_quota=True,user_id='0b1a1d5d222d483989d779ec8279ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55316d44-03e2-4b23-988b-f13ae5d2305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55316d44-03e2-4b23-988b-f13ae5d2305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73036908-ae7f-49db-8bfd-42f339abf019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73036908-ae7f-49db-8bfd-42f339abf019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e396c4b7-6d5b-499a-9602-0a3dddfeec69', 'volume_name': 'volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc3c383-e15c-4a34-9c83-9f696dddbec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc3c383-e15c-4a34-9c83-9f696dddbec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f0e56-ca90-4511-b2b7-2526eb72c9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:43 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Volume e396c4b7-6d5b-499a-9602-0a3dddfeec69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69', 'volume_size': 1} Jun 24 16:19:43 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:44 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 1.018s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:19:44 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Converted 1024.00 MB image at 158.54 MB/s Jun 24 16:19:44 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 is being set with open permissions: ugo+rw Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:44 devstack sudo[114429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 Jun 24 16:19:44 devstack sudo[114429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (6800f09d-c465-461f-96ab-2a9591f1d6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26a3770-f631-4142-a300-d5110856cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26a3770-f631-4142-a300-d5110856cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058579325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215aa785-6284-4c0e-a094-4531cbf1e71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:45Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ded3ad-31f4-4845-b604-57f4d87c5f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ded3ad-31f4-4845-b604-57f4d87c5f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c760fed6-5fef-4527-9b85-2078cfc7b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c760fed6-5fef-4527-9b85-2078cfc7b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215aa785-6284-4c0e-a094-4531cbf1e71b', 'volume_name': 'volume-215aa785-6284-4c0e-a094-4531cbf1e71b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4609be-ea71-4547-8237-d046f9eff27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4609be-ea71-4547-8237-d046f9eff27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4929b642-ef8c-44f3-b3bd-f948fe36c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:44 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume 215aa785-6284-4c0e-a094-4531cbf1e71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215aa785-6284-4c0e-a094-4531cbf1e71b', 'volume_size': 1} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:44 devstack sudo[114429]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54" returned: 0 in 0.651s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:44 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-790d0059-c58f-46c4-9aaa-c0a568a84b54" released by "_copy_volume_from_snapshot" :: held 9.884s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-a3399590-017a-44be-817d-e6d9d2abc120-790d0059-c58f-46c4-9aaa-c0a568a84b54" released by "_create_volume_from_snapshot" :: held 9.927s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.962s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.789s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865669a7-ac4b-4947-a0b7-d1e1c572d220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0110dcaf8254cb985672e5bb6b351c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:31Z,use_quota=True,user_id='2743869721c54236858facde455deda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Creating volume 865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:45 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:45 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 1073741824 Jun 24 16:19:45 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f06eda-bdc7-4d2d-8e26-5f67a32c9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790d0059-c58f-46c4-9aaa-c0a568a84b54', 'volume_size': 1, 'snapshot_id': 'a3399590-017a-44be-817d-e6d9d2abc120'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4df2c4c-acfe-4417-89c5-b203c964dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:45 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Volume volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 (790d0059-c58f-46c4-9aaa-c0a568a84b54): created successfully Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4df2c4c-acfe-4417-89c5-b203c964dacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Flow 'volume_create_manager' (dcfc5047-f979-4457-9ce0-52bd63bb15bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:45 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-6dc19552-3161-4c7f-a050-6b5b1c8518a6 tempest-SnapshotDependencyTests-1814424047 None] Created volume successfully. Jun 24 16:19:45 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 1073741824" returned: 0 in 0.807s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:45 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:45 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:45 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-a3399590-017a-44be-817d-e6d9d2abc120-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-a3399590-017a-44be-817d-e6d9d2abc120-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-quobyte-f404e27b-2380-4d1f-8885-1fbdd04edb90" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-f404e27b-2380-4d1f-8885-1fbdd04edb90" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-quobyte-a3399590-017a-44be-817d-e6d9d2abc120" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-a3399590-017a-44be-817d-e6d9d2abc120" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Deleting offline snapshot a3399590-017a-44be-817d-e6d9d2abc120 of volume f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] snapshot_file for this snap is: volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b32e3-3de8-40ec-ac73-a285cae9eff9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:46 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 Jun 24 16:19:46 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:46 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 0 in 0.644s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540984645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e396c4b7-6d5b-499a-9602-0a3dddfeec69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359ce0dffc354d3d852bb4fe51aec563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:44Z,use_quota=True,user_id='0b1a1d5d222d483989d779ec8279ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Creating volume e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:46 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:46 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 1073741824 Jun 24 16:19:46 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Attempting download of cde99ab9-92fa-4d09-8fd0-d1083d047d8b ((None, [{'url': 'file:///opt/stack/data/glance/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'metadata': {}}])) to volume 865669a7-ac4b-4947-a0b7-d1e1c572d220. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd9f62-6854-4257-9efc-8cfac72aa7ab]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:46 devstack sudo[114445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq Jun 24 16:19:46 devstack sudo[114445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:46 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120" returned: 0 in 0.803s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:46 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f404e27b-2380-4d1f-8885-1fbdd04edb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[21348fb6-ff10-4986-8a01-b61c093632f1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:47 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:47 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:47 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 1073741824" returned: 0 in 0.873s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:47 devstack sudo[114445]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq" returned: 0 in 0.818s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:47 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:19:47 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:47 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq Jun 24 16:19:47 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:47 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 0.787s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:47 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:47 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 Jun 24 16:19:47 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:48 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 0.662s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.155s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058579325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215aa785-6284-4c0e-a094-4531cbf1e71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:45Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating volume 215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:48 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:48 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b 1073741824 Jun 24 16:19:48 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f0e56-ca90-4511-b2b7-2526eb72c9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55985198-2f50-49fa-b58c-13b3f16f90bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:48 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Volume volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 (e396c4b7-6d5b-499a-9602-0a3dddfeec69): created successfully Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55985198-2f50-49fa-b58c-13b3f16f90bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Flow 'volume_create_manager' (6588906b-f6be-45fd-b73b-c38be21e2ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:48 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:48 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e9b2fbea-e162-478b-bc80-e6a59f837a5a tempest-VolumeDependencyTests-579580157 None] Created volume successfully. Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq" returned: 1 in 0.774s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_41cqkqwq' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31177c1-237b-4dca-8a5f-a86c61b5b7ef]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:48 devstack sudo[114472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD Jun 24 16:19:48 devstack sudo[114472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:48 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120" returned: 0 in 0.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:48 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:48 devstack sudo[114478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120 Jun 24 16:19:48 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:49 devstack sudo[114472]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:49 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b 1073741824" returned: 0 in 0.987s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:49 devstack sudo[114486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD Jun 24 16:19:49 devstack sudo[114486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:49 devstack sudo[114487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b Jun 24 16:19:49 devstack sudo[114487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:49 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90.a3399590-017a-44be-817d-e6d9d2abc120" returned: 0 in 0.764s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-a3399590-017a-44be-817d-e6d9d2abc120" released by "_delete_snapshot" :: held 3.244s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-f404e27b-2380-4d1f-8885-1fbdd04edb90" released by "delete_snapshot" :: held 3.274s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Created reservations ['5ab3bd23-41f1-42e2-8592-9ba6ec4ae734', 'cf799c04-f0b7-41ed-b490-0b5c878bb884', 'edc93eef-8deb-465b-aa81-e50c28d846d3', '14cc7bd3-1ab1-499f-9802-f4ab07e019c3'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Delete snapshot completed successfully. Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-60fef4b5-3c07-4ca3-b156-5bbcc3a41d25 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-a3399590-017a-44be-817d-e6d9d2abc120-delete_snapshot" released by "delete_snapshot" :: held 3.412s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:49 devstack sudo[114486]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD" returned: 1 in 0.762s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] cde99ab9-92fa-4d09-8fd0-d1083d047d8b was raw, converting to raw {{(pid=93867) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:49 devstack sudo[114487]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.675s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:49 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:49 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4929b642-ef8c-44f3-b3bd-f948fe36c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215aa785-6284-4c0e-a094-4531cbf1e71b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3ccfd2-fe62-4d91-9fb7-700eef3770ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Creating offline snapshot 9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 of volume e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:19:49 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume volume-215aa785-6284-4c0e-a094-4531cbf1e71b (215aa785-6284-4c0e-a094-4531cbf1e71b): created successfully Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3ccfd2-fe62-4d91-9fb7-700eef3770ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (6800f09d-c465-461f-96ab-2a9591f1d6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5145dfd-5f56-401d-ad95-3a90b58c346e]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:49 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:49 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ae9b2645-c2de-40d6-b18a-eaa04bf5fe9f tempest-CreateVolumesFromSnapshotTest-614105882 None] Created volume successfully. Jun 24 16:19:50 devstack sudo[114497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:19:50 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-f404e27b-2380-4d1f-8885-1fbdd04edb90-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-f404e27b-2380-4d1f-8885-1fbdd04edb90-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-quobyte-f404e27b-2380-4d1f-8885-1fbdd04edb90" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-f404e27b-2380-4d1f-8885-1fbdd04edb90" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[804348a9-8538-49c1-a8e1-4b3149c3e879]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:50 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 0 in 0.789s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cde99ab9-92fa-4d09-8fd0-d1083d047d8b_j_8zw7tpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:19:50 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:50 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 1G Jun 24 16:19:50 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:50 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:50 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:50 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 0.851s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:50 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:50 devstack sudo[114509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 1G Jun 24 16:19:50 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:51 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 0.773s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:51 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 1G" returned: 0 in 0.718s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:51 devstack sudo[114518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90 Jun 24 16:19:51 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[199106e7-3fe8-4f4d-b1f1-480162d0b2a8]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:51 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:51 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:51 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 1G" returned: 0 in 0.851s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:51 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 Jun 24 16:19:51 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:51 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:51 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-f404e27b-2380-4d1f-8885-1fbdd04edb90" returned: 0 in 0.690s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-f404e27b-2380-4d1f-8885-1fbdd04edb90" released by "delete_volume" :: held 1.532s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Created reservations ['f0fe5f8a-8808-43a6-b3e4-d3110c0de9b0', '197153bd-97eb-439c-b1a0-7a51d3245888', 'e14785b5-1587-451e-a472-6b498c1f8b3f', '67983fc3-8d6e-4926-9294-6c7ea280e146'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:52 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 0 in 0.806s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:52 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:52 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:52 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:52 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:52 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" returned: 0 in 0.748s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:52 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 is being set with open permissions: ugo+rw Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:52 devstack sudo[114536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 Jun 24 16:19:52 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-790d0059-c58f-46c4-9aaa-c0a568a84b54-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-790d0059-c58f-46c4-9aaa-c0a568a84b54-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "cinder-quobyte-790d0059-c58f-46c4-9aaa-c0a568a84b54" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-790d0059-c58f-46c4-9aaa-c0a568a84b54" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b1188c-0c46-4967-a337-88faba8ba0b2]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:52 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.721s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:52 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Deleted volume successfully. Jun 24 16:19:52 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-9b885953-25e3-4afe-93d7-af1fcb87e181 tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-f404e27b-2380-4d1f-8885-1fbdd04edb90-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:52 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 Jun 24 16:19:52 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:53 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 1 in 0.851s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Downloaded image cde99ab9-92fa-4d09-8fd0-d1083d047d8b ((None, [{'url': 'file:///opt/stack/data/glance/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'metadata': {}}])) to volume 865669a7-ac4b-4947-a0b7-d1e1c572d220 successfully. {{(pid=93867) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Temporary image cde99ab9-92fa-4d09-8fd0-d1083d047d8b for user 2743869721c54236858facde455deda9 is deleted. {{(pid=93867) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.volume_utils [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Marking volume 865669a7-ac4b-4947-a0b7-d1e1c572d220 as bootable. {{(pid=93867) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Copying metadata from image cde99ab9-92fa-4d09-8fd0-d1083d047d8b to 865669a7-ac4b-4947-a0b7-d1e1c572d220. {{(pid=93867) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Creating volume glance metadata for volume 865669a7-ac4b-4947-a0b7-d1e1c572d220 backed by image cde99ab9-92fa-4d09-8fd0-d1083d047d8b with: {'image_id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b98106b89bcd8fbac1b33e0fbc7b0bb1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93867) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41219452-a804-4c33-9af7-9589f37d6ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865669a7-ac4b-4947-a0b7-d1e1c572d220', 'volume_size': 1, 'image_id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b98106b89bcd8fbac1b33e0fbc7b0bb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd0110dcaf8254cb985672e5bb6b351c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5f623580bfba68fef6f0f6c618f0b7ea14b38ff06347a31daac72ffccba85758893c2a7e8d7e8a21a46e4df4afc75d0839de26d6d96503b75a3e373040fe3697', 'id': 'cde99ab9-92fa-4d09-8fd0-d1083d047d8b', 'created_at': datetime.datetime(2026, 6, 24, 14, 19, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 14, 19, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cde99ab9-92fa-4d09-8fd0-d1083d047d8b/file', 'properties': {}}, 'image_service': }' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f554fac-07a0-4c76-bf95-7b7e5d8426ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:53 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" returned: 0 in 0.784s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:53 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Volume volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 (865669a7-ac4b-4947-a0b7-d1e1c572d220): created successfully Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f554fac-07a0-4c76-bf95-7b7e5d8426ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Flow 'volume_create_manager' (d866387f-4038-4143-87bd-6081d2682a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:53 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-37597699-4ab0-4d83-a48f-3b8856b4703c tempest-VolumeImageDependencyTests-1293629779 None] Created volume successfully. Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:53 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info Jun 24 16:19:53 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:53 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54" returned: 0 in 0.776s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:53 devstack sudo[114550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54 Jun 24 16:19:53 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:53 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info" returned: 0 in 0.689s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:53 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info is being set with open permissions: ugo+rw Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:53 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info Jun 24 16:19:53 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:53 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Acquiring lock "cinder-865669a7-ac4b-4947-a0b7-d1e1c572d220-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Lock "cinder-865669a7-ac4b-4947-a0b7-d1e1c572d220-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Acquiring lock "cinder-quobyte-865669a7-ac4b-4947-a0b7-d1e1c572d220" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Lock "cinder-quobyte-865669a7-ac4b-4947-a0b7-d1e1c572d220" acquired by "delete_volume" :: waited 0.015s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc99214-c2ae-4fbc-8cd1-dd4e29d28d30]: (4, 'raw') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:54 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:54 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:54 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-790d0059-c58f-46c4-9aaa-c0a568a84b54" returned: 0 in 0.719s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-quobyte-790d0059-c58f-46c4-9aaa-c0a568a84b54" released by "delete_volume" :: held 1.550s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Created reservations ['f63565e7-c419-4451-af74-3c9af87cc619', '2a501ebd-310f-4b17-b116-a50d508baf62', 'c98b8209-cb2c-4913-8ccd-821d3bf95cea', 'c0fe8fb1-6237-4098-80fa-241c0b4ec923'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:54 devstack sudo[114560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:54 devstack sudo[114560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:54 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.info" returned: 0 in 0.728s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.789s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.241s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating offline snapshot 5857d4b4-afe5-4048-ae8b-740fef961489 of volume 215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:19:54 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-a1ea483a-22e0-4a7f-827a-1ee7cb40b261 tempest-VolumeDependencyTests-579580157 None] Create snapshot completed successfully Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[44775fa8-43c3-46a8-b1b5-b480bf919b52]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:54 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b Jun 24 16:19:54 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:54 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 0 in 0.799s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:54 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:55 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:55 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:55 devstack sudo[114560]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.743s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:55 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Deleted volume successfully. Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ef70b91d-b7b8-4594-bedd-430f374fd51e tempest-SnapshotDependencyTests-1814424047 None] Lock "cinder-790d0059-c58f-46c4-9aaa-c0a568a84b54-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:55 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b" returned: 0 in 0.896s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:55 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 1G Jun 24 16:19:55 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:55 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 1 in 0.890s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220' failed. Not Retrying. {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 16:19:55 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:55 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220 Jun 24 16:19:55 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=134,cinder:UPDATE=176,cinder:INSERT=50,cinder:DELETE=18 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Flow 'volume_create_manager' (b1b31968-4b76-47f2-9130-bc79827074f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8b98f0-2b90-41f6-9212-b7d3511ec38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8b98f0-2b90-41f6-9212-b7d3511ec38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1781403881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58817616-3389-412a-a7b4-36895d8bd662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359ce0dffc354d3d852bb4fe51aec563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:19:56Z,use_quota=True,user_id='0b1a1d5d222d483989d779ec8279ccd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3ae291-1bca-49d7-8eb6-0019531582a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3ae291-1bca-49d7-8eb6-0019531582a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f9f7d6-96f0-4af0-a8c6-fe37f77ba144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f9f7d6-96f0-4af0-a8c6-fe37f77ba144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '58817616-3389-412a-a7b4-36895d8bd662', 'volume_name': 'volume-58817616-3389-412a-a7b4-36895d8bd662', 'volume_size': 1, 'snapshot_id': '9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66ddd99-de99-4c42-9291-da93be333987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66ddd99-de99-4c42-9291-da93be333987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060c537b-6cac-4765-af3d-f97d138950f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:19:56 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Volume 58817616-3389-412a-a7b4-36895d8bd662: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-58817616-3389-412a-a7b4-36895d8bd662', 'volume_size': 1, 'snapshot_id': '9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35'} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=130,cinder:UPDATE=175,cinder:DELETE=15,cinder:INSERT=47 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:56 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-865669a7-ac4b-4947-a0b7-d1e1c572d220" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Lock "cinder-quobyte-865669a7-ac4b-4947-a0b7-d1e1c572d220" released by "delete_volume" :: held 2.566s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:56 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 1G" returned: 0 in 1.107s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215aa785-6284-4c0e-a094-4531cbf1e71b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Created reservations ['81be9b24-e116-494f-ac1b-00c6d5ebec90', '21caf846-d27a-4950-bade-341bd67b2a04', 'e58f0e00-8520-4149-b51c-482b62e572c4', '3a509657-c932-409d-844a-cfb6a021dc3e'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:19:56 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215aa785-6284-4c0e-a094-4531cbf1e71b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 Jun 24 16:19:56 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:56 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:56 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:19:56 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:57 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.763s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:57 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:57 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:19:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215aa785-6284-4c0e-a094-4531cbf1e71b -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489" returned: 0 in 0.859s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:57 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 is being set with open permissions: ugo+rw Jun 24 16:19:57 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:57 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Deleted volume successfully. Jun 24 16:19:57 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 Jun 24 16:19:57 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:57 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-eacff11f-62b0-424a-9577-f87681d50b17 tempest-VolumeImageDependencyTests-1293629779 None] Lock "cinder-865669a7-ac4b-4947-a0b7-d1e1c572d220-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:19:58 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489" returned: 0 in 0.706s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:58 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:58 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info Jun 24 16:19:58 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:59 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info" returned: 0 in 0.748s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:59 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info is being set with open permissions: ugo+rw Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:19:59 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info Jun 24 16:19:59 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:19:59 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.info" returned: 0 in 0.776s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.204s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.448s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-quobyte-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35-58817616-3389-412a-a7b4-36895d8bd662" by "_create_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35-58817616-3389-412a-a7b4-36895d8bd662" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Creating volume 58817616-3389-412a-a7b4-36895d8bd662 from snapshot 9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-quobyte-58817616-3389-412a-a7b4-36895d8bd662" by "_copy_volume_from_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:19:59 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-bcb36a12-4a78-4acd-a6bd-388e493a5ed0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Create snapshot completed successfully Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-58817616-3389-412a-a7b4-36895d8bd662" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] snapshot: 9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35, volume: 58817616-3389-412a-a7b4-36895d8bd662, {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c2ca8d-9fde-49f4-b74c-c10d9c9ae171]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:19:59 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:00 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 Jun 24 16:20:00 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:00 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" returned: 0 in 0.887s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:20:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] will copy from snapshot at /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 16:20:00 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Creating direct copy from snapshot {{(pid=93867) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 16:20:00 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58a798-b5a4-43e7-abfa-948158099b93]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:00 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:01 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:20:01 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Flow 'volume_create_manager' (f8445ebe-cec7-42ba-bd22-3cebdb857478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fac0b7-65c3-4ae5-bc2d-7a10bcd37a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fac0b7-65c3-4ae5-bc2d-7a10bcd37a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974a193f-9622-4cba-a93a-ae40902a8c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d265ac03de1438c97047ab3430b606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:01Z,use_quota=True,user_id='3cc6cdbf8048402f8e1a072e77eb0635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19ae0e6-da9b-4892-a871-9d53d9d13a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19ae0e6-da9b-4892-a871-9d53d9d13a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398f8100-6501-4f73-a429-39b184c6de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398f8100-6501-4f73-a429-39b184c6de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974a193f-9622-4cba-a93a-ae40902a8c7e', 'volume_name': 'volume-974a193f-9622-4cba-a93a-ae40902a8c7e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a5a2ea-a4db-4eb0-a0f3-83fb7af82f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a5a2ea-a4db-4eb0-a0f3-83fb7af82f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a50c64c-da09-46f9-a6a4-7e8a26b3a2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Volume 974a193f-9622-4cba-a93a-ae40902a8c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974a193f-9622-4cba-a93a-ae40902a8c7e', 'volume_size': 1} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (b6ec947b-1948-4423-9a10-52bf06ffda52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2cd158-4a04-40b1-a2f9-4d3d618fc9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2cd158-4a04-40b1-a2f9-4d3d618fc9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-276419395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879aa1bf-6213-4a1a-91b9-09a506ec9569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:02Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5492e2c8-6356-4ccd-b423-9c1236a2f685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5492e2c8-6356-4ccd-b423-9c1236a2f685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231a512e-0a09-46b8-a1af-fef8a2c607fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231a512e-0a09-46b8-a1af-fef8a2c607fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879aa1bf-6213-4a1a-91b9-09a506ec9569', 'volume_name': 'volume-879aa1bf-6213-4a1a-91b9-09a506ec9569', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154fb76e-3b8d-4fac-a420-eff398523c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154fb76e-3b8d-4fac-a420-eff398523c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d477628d-58e3-4c06-ae24-f13039e17135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:01 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume 879aa1bf-6213-4a1a-91b9-09a506ec9569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879aa1bf-6213-4a1a-91b9-09a506ec9569', 'volume_size': 1} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:01 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 1.039s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG cinder.utils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Path /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 not found in is_blk_device check {{(pid=93867) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 16:20:01 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:01 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 Jun 24 16:20:01 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (40dece83-cb25-4902-9eae-3971921ee6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6186e54-add0-4f1c-96c6-f421870ed768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6186e54-add0-4f1c-96c6-f421870ed768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425827115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d12850-d643-46e4-bbb3-068143b802a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:02Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ed6eba-d3d6-4bfb-8dec-64500cafa8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ed6eba-d3d6-4bfb-8dec-64500cafa8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcede152-d545-45ca-a845-73eb4be935da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcede152-d545-45ca-a845-73eb4be935da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d12850-d643-46e4-bbb3-068143b802a8', 'volume_name': 'volume-66d12850-d643-46e4-bbb3-068143b802a8', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5862cb89-44fe-4919-a13f-58d67dc36b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5862cb89-44fe-4919-a13f-58d67dc36b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd241abf-09b4-4216-ba2a-9f78699914f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume 66d12850-d643-46e4-bbb3-068143b802a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d12850-d643-46e4-bbb3-068143b802a8', 'volume_size': 1} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (3164c42d-d752-4bed-919a-0bf239f2606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0227be4a-e1a1-4932-8362-6cca4cef83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0227be4a-e1a1-4932-8362-6cca4cef83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167074058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c351a89e-b192-4d1c-b585-153966f2104d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:02Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4d5adc-98d4-4278-a089-a4fa7090bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4d5adc-98d4-4278-a089-a4fa7090bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa7005c-2476-4781-b544-428d358bb4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa7005c-2476-4781-b544-428d358bb4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c351a89e-b192-4d1c-b585-153966f2104d', 'volume_name': 'volume-c351a89e-b192-4d1c-b585-153966f2104d', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c23b22-f2c0-401c-a9fd-1fd262a53e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c23b22-f2c0-401c-a9fd-1fd262a53e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d10ce2d-7364-4f83-8f0f-5267b1003586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:02 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume c351a89e-b192-4d1c-b585-153966f2104d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c351a89e-b192-4d1c-b585-153966f2104d', 'volume_size': 1} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (3aaf0776-8fc5-42f6-aeef-216db7ad3ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:02 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd51dce-51c5-4e11-abde-c8434a12e32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd51dce-51c5-4e11-abde-c8434a12e32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1156541399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95cdfe8-47c4-4131-89e6-077ece37347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:03Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4b7816-8681-46be-96ab-bc7595a3d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4b7816-8681-46be-96ab-bc7595a3d103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cb4b10-980a-479a-9dbc-2c1667fc86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cb4b10-980a-479a-9dbc-2c1667fc86e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95cdfe8-47c4-4131-89e6-077ece37347b', 'volume_name': 'volume-e95cdfe8-47c4-4131-89e6-077ece37347b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8a17bc-fbb3-47b4-b4f4-049d4260f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8a17bc-fbb3-47b4-b4f4-049d4260f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c19b76-7167-42dc-af05-aa8554869e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:03 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume e95cdfe8-47c4-4131-89e6-077ece37347b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95cdfe8-47c4-4131-89e6-077ece37347b', 'volume_size': 1} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (2d19b3ba-1044-45d1-91a8-7fa2a33a2bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeb7c74-999d-4694-b12f-18db6b3b8d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:03 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeb7c74-999d-4694-b12f-18db6b3b8d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-887714186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae53158-43d0-4d34-b2db-d4153756d685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:04Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb79cd55-a2bc-4a36-89dd-6494e2f32205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb79cd55-a2bc-4a36-89dd-6494e2f32205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd990f0d-a356-466b-98b5-67ef555d6a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd990f0d-a356-466b-98b5-67ef555d6a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae53158-43d0-4d34-b2db-d4153756d685', 'volume_name': 'volume-3ae53158-43d0-4d34-b2db-d4153756d685', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2c466d-a0ab-4450-bc10-95668e155d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2c466d-a0ab-4450-bc10-95668e155d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10542959-f1cc-40f2-83ae-3b6fc4d8e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:04 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume 3ae53158-43d0-4d34-b2db-d4153756d685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae53158-43d0-4d34-b2db-d4153756d685', 'volume_size': 1} Jun 24 16:20:04 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:08 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662" returned: 0 in 6.116s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:08 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[730a1deb-cd62-49d5-be41-eef4532d73c1]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:08 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:08 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:20:08 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:09 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 0.949s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.image.image_utils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Image conversion details: src /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 {{(pid=93867) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 16:20:09 devstack cinder-volume[93867]: INFO cinder.image.image_utils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Converted 1024.00 MB image at 167.41 MB/s Jun 24 16:20:09 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 is being set with open permissions: ugo+rw Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:09 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 Jun 24 16:20:09 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:09 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662" returned: 0 in 0.646s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-58817616-3389-412a-a7b4-36895d8bd662" released by "_copy_volume_from_snapshot" :: held 9.773s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35-58817616-3389-412a-a7b4-36895d8bd662" released by "_create_volume_from_snapshot" :: held 9.818s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.850s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.092s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974a193f-9622-4cba-a93a-ae40902a8c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d265ac03de1438c97047ab3430b606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:01Z,use_quota=True,user_id='3cc6cdbf8048402f8e1a072e77eb0635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Creating volume 974a193f-9622-4cba-a93a-ae40902a8c7e {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:09 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:09 devstack sudo[114683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e 1073741824 Jun 24 16:20:09 devstack sudo[114683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060c537b-6cac-4765-af3d-f97d138950f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58817616-3389-412a-a7b4-36895d8bd662', 'volume_size': 1, 'snapshot_id': '9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35'}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe16d4c-0f22-4f66-bcae-b4102ade3f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:09 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Volume volume-58817616-3389-412a-a7b4-36895d8bd662 (58817616-3389-412a-a7b4-36895d8bd662): created successfully Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe16d4c-0f22-4f66-bcae-b4102ade3f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:09 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Flow 'volume_create_manager' (b1b31968-4b76-47f2-9130-bc79827074f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:09 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e637661d-c78e-4bf4-93f1-7aa08669f871 tempest-VolumeDependencyTests-579580157 None] Created volume successfully. Jun 24 16:20:10 devstack sudo[114683]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e 1073741824" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Lock "cinder-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-quobyte-e396c4b7-6d5b-499a-9602-0a3dddfeec69" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-e396c4b7-6d5b-499a-9602-0a3dddfeec69" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-quobyte-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Deleting offline snapshot 9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 of volume e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:20:10 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e Jun 24 16:20:10 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] snapshot_file for this snap is: volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c51266-07ef-4987-b8fa-fc394869e1b7]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:10 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:10 devstack sudo[114690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 Jun 24 16:20:10 devstack sudo[114690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:11 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e" returned: 0 in 0.678s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.332s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-276419395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879aa1bf-6213-4a1a-91b9-09a506ec9569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:02Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating volume 879aa1bf-6213-4a1a-91b9-09a506ec9569 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:11 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a50c64c-da09-46f9-a6a4-7e8a26b3a2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974a193f-9622-4cba-a93a-ae40902a8c7e', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031466d2-c2c3-49fb-a5e7-115dfe83d353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:11 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 1073741824 Jun 24 16:20:11 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:11 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Volume volume-974a193f-9622-4cba-a93a-ae40902a8c7e (974a193f-9622-4cba-a93a-ae40902a8c7e): created successfully Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031466d2-c2c3-49fb-a5e7-115dfe83d353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Flow 'volume_create_manager' (f8445ebe-cec7-42ba-bd22-3cebdb857478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:11 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-9c53d082-2652-463b-a0ea-20759a35f8c2 tempest-CinderUnicodeTest-1797103226 None] Created volume successfully. Jun 24 16:20:11 devstack sudo[114690]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" returned: 0 in 0.801s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[728e68dc-2d9d-4ab0-bf65-11e0231a08d9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:11 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:11 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:20:11 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:12 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 1073741824" returned: 0 in 0.872s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:12 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 Jun 24 16:20:12 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:12 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 0.815s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:12 devstack sudo[114709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 Jun 24 16:20:12 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.flows.manager.create_volume [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93867) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Flow 'volume_create_manager' (fcdd267f-ec14-402d-967c-a3d403732299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddef0fc6-13ee-4d1a-8921-e4fa3a3fc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddef0fc6-13ee-4d1a-8921-e4fa3a3fc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2003665159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b3a32e-0605-4979-a178-1eeba1e24274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d265ac03de1438c97047ab3430b606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:13Z,use_quota=True,user_id='3cc6cdbf8048402f8e1a072e77eb0635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5630cb37-eaa7-4ada-9ee1-cb199b3c95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:12 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5630cb37-eaa7-4ada-9ee1-cb199b3c95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790e3013-9d22-455a-b371-f8dd60737e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790e3013-9d22-455a-b371-f8dd60737e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b3a32e-0605-4979-a178-1eeba1e24274', 'volume_name': 'volume-33b3a32e-0605-4979-a178-1eeba1e24274', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ea3a13-4e3d-494a-b254-c539b6b80e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ea3a13-4e3d-494a-b254-c539b6b80e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b50a083-8b05-41ac-8bc5-930cf361f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:12 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Volume 33b3a32e-0605-4979-a178-1eeba1e24274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b3a32e-0605-4979-a178-1eeba1e24274', 'volume_size': 1} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569" returned: 0 in 0.789s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.747s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425827115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d12850-d643-46e4-bbb3-068143b802a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:02Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating volume 66d12850-d643-46e4-bbb3-068143b802a8 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:12 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:12 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:13 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 1073741824 Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d477628d-58e3-4c06-ae24-f13039e17135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879aa1bf-6213-4a1a-91b9-09a506ec9569', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:13 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b08bbf-4c94-448e-bb38-97e1b7a68f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:13 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 (879aa1bf-6213-4a1a-91b9-09a506ec9569): created successfully Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b08bbf-4c94-448e-bb38-97e1b7a68f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (b6ec947b-1948-4423-9a10-52bf06ffda52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:13 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-67a19be9-225d-4868-8dda-6659126d9bd3 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created volume successfully. Jun 24 16:20:13 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" returned: 0 in 0.963s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:13 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35 Jun 24 16:20:13 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:13 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69.9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:13 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 1073741824" returned: 0 in 0.958s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35" released by "_delete_snapshot" :: held 3.364s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-e396c4b7-6d5b-499a-9602-0a3dddfeec69" released by "delete_snapshot" :: held 3.407s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:13 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:13 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 Jun 24 16:20:13 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Created reservations ['89158e80-8b63-4f9f-9932-f6aea109cd89', '34047d82-808e-490e-adfb-c42e7bf4ac58', '5bee0650-8797-4c0c-82a6-d9ea3bcc1778', '084c3eef-c5a2-4979-97b9-fdc124cfa1f5'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Delete snapshot completed successfully. Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-d3954ba6-66c0-4fc9-a1f8-9d7cc05ff0fc tempest-VolumeDependencyTests-579580157 None] Lock "cinder-9ebfc1a4-cd16-45cd-b5f7-159ed92f7f35-delete_snapshot" released by "delete_snapshot" :: held 3.565s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:14 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.162s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167074058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c351a89e-b192-4d1c-b585-153966f2104d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:02Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating volume c351a89e-b192-4d1c-b585-153966f2104d {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:14 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:14 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d 1073741824 Jun 24 16:20:14 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd241abf-09b4-4216-ba2a-9f78699914f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d12850-d643-46e4-bbb3-068143b802a8', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d318232-e8d0-4abf-8393-3b236e33537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:14 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume volume-66d12850-d643-46e4-bbb3-068143b802a8 (66d12850-d643-46e4-bbb3-068143b802a8): created successfully Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d318232-e8d0-4abf-8393-3b236e33537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (40dece83-cb25-4902-9eae-3971921ee6c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:14 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-d6caa4a9-d036-4c63-8b8d-b54b583d90c1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created volume successfully. Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-e396c4b7-6d5b-499a-9602-0a3dddfeec69-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-e396c4b7-6d5b-499a-9602-0a3dddfeec69-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-quobyte-e396c4b7-6d5b-499a-9602-0a3dddfeec69" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-e396c4b7-6d5b-499a-9602-0a3dddfeec69" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[27575219-6263-4215-a6fa-f6435ed476d7]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:14 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:14 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:20:14 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:15 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d 1073741824" returned: 0 in 0.861s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:15 devstack sudo[114739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d Jun 24 16:20:15 devstack sudo[114739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:15 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 0.779s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:15 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:15 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69 Jun 24 16:20:15 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:16 devstack sudo[114739]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d" returned: 0 in 0.650s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.003s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1156541399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95cdfe8-47c4-4131-89e6-077ece37347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:03Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating volume e95cdfe8-47c4-4131-89e6-077ece37347b {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:16 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d10ce2d-7364-4f83-8f0f-5267b1003586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c351a89e-b192-4d1c-b585-153966f2104d', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:16 devstack sudo[114745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b 1073741824 Jun 24 16:20:16 devstack sudo[114745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1987fad6-dcae-4d18-8d80-40a2df08c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:16 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume volume-c351a89e-b192-4d1c-b585-153966f2104d (c351a89e-b192-4d1c-b585-153966f2104d): created successfully Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1987fad6-dcae-4d18-8d80-40a2df08c51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (3164c42d-d752-4bed-919a-0bf239f2606c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:16 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-47f3f947-662d-44f0-9b4f-74f7c53dffc0 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created volume successfully. Jun 24 16:20:16 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e396c4b7-6d5b-499a-9602-0a3dddfeec69" returned: 0 in 0.648s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-e396c4b7-6d5b-499a-9602-0a3dddfeec69" released by "delete_volume" :: held 1.496s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Created reservations ['05d81b19-b83b-4472-9a42-aa530fb83f0e', '9d563132-6a4c-4905-a3ea-23f0f2b31939', '580548ea-83e5-4f89-b74b-bcca95fe2068', 'a66c5ea5-fe21-4f3d-a01c-61d7c59efa3b'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:16 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:16 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:16 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-58817616-3389-412a-a7b4-36895d8bd662-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Lock "cinder-58817616-3389-412a-a7b4-36895d8bd662-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Acquiring lock "cinder-quobyte-58817616-3389-412a-a7b4-36895d8bd662" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:17 devstack sudo[114745]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b 1073741824" returned: 0 in 0.913s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-58817616-3389-412a-a7b4-36895d8bd662" acquired by "delete_volume" :: waited 0.018s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:17 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.693s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef07341-e4ec-4ae2-92b0-b24d97fd2bae]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Deleted volume successfully. Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3a529a2-d967-433f-8618-5381693950c6 tempest-VolumeDependencyTests-579580157 None] Lock "cinder-e396c4b7-6d5b-499a-9602-0a3dddfeec69-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:17 devstack sudo[114754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b Jun 24 16:20:17 devstack sudo[114754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:17 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 Jun 24 16:20:17 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:17 devstack sudo[114754]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b" returned: 0 in 0.661s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.777s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-887714186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae53158-43d0-4d34-b2db-d4153756d685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be937d335d4488b8869d2ab824431a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:04Z,use_quota=True,user_id='b45e2c18c98c4b6a9018500e2e7e1369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Creating volume 3ae53158-43d0-4d34-b2db-d4153756d685 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:17 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c19b76-7167-42dc-af05-aa8554869e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95cdfe8-47c4-4131-89e6-077ece37347b', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:17 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 1073741824 Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6d48bd-54d1-45df-9e89-65dafc804164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:17 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:17 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume volume-e95cdfe8-47c4-4131-89e6-077ece37347b (e95cdfe8-47c4-4131-89e6-077ece37347b): created successfully Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6d48bd-54d1-45df-9e89-65dafc804164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (3aaf0776-8fc5-42f6-aeef-216db7ad3ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:17 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662" returned: 0 in 0.780s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:17 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:17 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-33998d52-5c9b-4aa6-96e7-d166159a8955 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created volume successfully. Jun 24 16:20:17 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662 Jun 24 16:20:17 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:18 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-58817616-3389-412a-a7b4-36895d8bd662" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Lock "cinder-quobyte-58817616-3389-412a-a7b4-36895d8bd662" released by "delete_volume" :: held 1.467s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Created reservations ['9d816dc5-dab3-4e2a-aa60-2019c9153ab4', 'ffe32ad0-5a00-4f2a-9273-8dab6c1274d4', '79d827c3-62df-4644-9205-f034209be57b', 'a9aecbd0-82f8-4bd8-babf-9d27d0a9fbf3'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:18 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 1073741824" returned: 0 in 0.835s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:18 devstack sudo[114769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:18 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:18 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:18 devstack sudo[114771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 Jun 24 16:20:18 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:19 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.672s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Deleted volume successfully. Jun 24 16:20:19 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.475s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T14:20:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2003665159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b3a32e-0605-4979-a178-1eeba1e24274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d265ac03de1438c97047ab3430b606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T14:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T14:20:13Z,use_quota=True,user_id='3cc6cdbf8048402f8e1a072e77eb0635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788fc53e-cfc1-486d-ac30-4869b33f6e04),volume_type_id=788fc53e-cfc1-486d-ac30-4869b33f6e04)}" {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Creating volume 33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Selected osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 as target Quobyte volume. {{(pid=93867) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 16:20:19 devstack cinder-volume[93867]: INFO cinder.volume.drivers.remotefs [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] casted to osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56 Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 1073741824 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:19 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 1073741824 Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-87acccf6-c78c-49ec-9e78-f36921520e5c tempest-VolumeDependencyTests-579580157 None] Lock "cinder-58817616-3389-412a-a7b4-36895d8bd662-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:19 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10542959-f1cc-40f2-83ae-3b6fc4d8e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae53158-43d0-4d34-b2db-d4153756d685', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ae73c9-bef4-4cf6-8a2e-e10575d03fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:19 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Volume volume-3ae53158-43d0-4d34-b2db-d4153756d685 (3ae53158-43d0-4d34-b2db-d4153756d685): created successfully Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ae73c9-bef4-4cf6-8a2e-e10575d03fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Flow 'volume_create_manager' (2d19b3ba-1044-45d1-91a8-7fa2a33a2bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:19 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-8b505a0f-1fb1-4a46-8724-bfe329d83cf9 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created volume successfully. Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-3ae53158-43d0-4d34-b2db-d4153756d685-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-3ae53158-43d0-4d34-b2db-d4153756d685-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:19 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-3ae53158-43d0-4d34-b2db-d4153756d685" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-3ae53158-43d0-4d34-b2db-d4153756d685" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e5c0cc-ca47-4896-baf7-36d4037a0386]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:20 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 Jun 24 16:20:20 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:20 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 1073741824" returned: 0 in 1.002s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:20 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 Jun 24 16:20:20 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:20 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685" returned: 0 in 0.936s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:20 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:21 devstack sudo[114788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685 Jun 24 16:20:21 devstack sudo[114788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:21 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274" returned: 0 in 0.716s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'} {{(pid=93867) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b50a083-8b05-41ac-8bc5-930cf361f667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b3a32e-0605-4979-a178-1eeba1e24274', 'volume_size': 1}' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4a6226-4e88-4218-9340-d38c5e02a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 16:20:21 devstack cinder-volume[93867]: INFO cinder.volume.flows.manager.create_volume [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Volume volume-33b3a32e-0605-4979-a178-1eeba1e24274 (33b3a32e-0605-4979-a178-1eeba1e24274): created successfully Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4a6226-4e88-4218-9340-d38c5e02a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93867) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Flow 'volume_create_manager' (fcdd267f-ec14-402d-967c-a3d403732299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93867) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 16:20:21 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-47da2051-b806-4083-b292-312873a74b7f tempest-CinderUnicodeTest-1797103226 None] Created volume successfully. Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Creating offline snapshot f440df79-142b-42df-9315-7fbbd4d571a6 of volume 33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e78d3-2948-4ee1-b05f-f3816c544602]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:21 devstack sudo[114788]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-3ae53158-43d0-4d34-b2db-d4153756d685" returned: 0 in 0.691s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-3ae53158-43d0-4d34-b2db-d4153756d685" released by "delete_volume" :: held 1.680s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['469a57f6-0175-468e-9be4-8f27a26d4538', '3f034939-b3d8-4eb9-b380-b478d688d1a6', 'ddea8d77-e883-4dbb-a62e-ef8553c28eed', '8d538aea-28eb-4918-bc12-80713b7bf91b'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:21 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 Jun 24 16:20:21 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:21 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:21 devstack sudo[114794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:21 devstack sudo[114794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-e95cdfe8-47c4-4131-89e6-077ece37347b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-e95cdfe8-47c4-4131-89e6-077ece37347b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-e95cdfe8-47c4-4131-89e6-077ece37347b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-e95cdfe8-47c4-4131-89e6-077ece37347b" acquired by "delete_volume" :: waited 0.021s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9384ab-9360-4a5b-ba70-5e262fcc9902]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:22 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b Jun 24 16:20:22 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:22 devstack sudo[114794]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.654s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:22 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleted volume successfully. Jun 24 16:20:22 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274" returned: 0 in 0.823s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 1G {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:22 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-279c2fcd-b3b3-4239-9a09-505543934396 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-3ae53158-43d0-4d34-b2db-d4153756d685-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:22 devstack sudo[114802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 1G Jun 24 16:20:22 devstack sudo[114802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:23 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b" returned: 0 in 0.762s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:23 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b Jun 24 16:20:23 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:23 devstack sudo[114802]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 1G" returned: 0 in 0.853s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b3a32e-0605-4979-a178-1eeba1e24274 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:23 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b3a32e-0605-4979-a178-1eeba1e24274 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 Jun 24 16:20:23 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:23 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-e95cdfe8-47c4-4131-89e6-077ece37347b" returned: 0 in 0.665s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-e95cdfe8-47c4-4131-89e6-077ece37347b" released by "delete_volume" :: held 1.476s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['ef37b439-3755-463b-aae0-eb83ee90cd35', 'fd4b647d-80c9-4dd6-9bed-52d1cde4dc88', '1ad14c08-604c-456f-8b84-c1255ac210e6', '6ddb9f51-4fc4-4112-8548-3cb85072bafb'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:23 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:23 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:23 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:24 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b3a32e-0605-4979-a178-1eeba1e24274 -F qcow2 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6" returned: 0 in 0.737s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:24 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 is being set with open permissions: ugo+rw Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:24 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 Jun 24 16:20:24 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-c351a89e-b192-4d1c-b585-153966f2104d-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-c351a89e-b192-4d1c-b585-153966f2104d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:24 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-c351a89e-b192-4d1c-b585-153966f2104d" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:24 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleted volume successfully. Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-c351a89e-b192-4d1c-b585-153966f2104d" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-5c9ca54a-de2e-4606-ab86-a50347da51c2 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-e95cdfe8-47c4-4131-89e6-077ece37347b-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04f893-68a7-4565-8bdc-d242ddb29b21]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:24 devstack sudo[114825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d Jun 24 16:20:24 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:24 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6" returned: 0 in 0.662s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:24 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:24 devstack sudo[114828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info Jun 24 16:20:24 devstack sudo[114828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:25 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d" returned: 0 in 0.776s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:25 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d Jun 24 16:20:25 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:25 devstack sudo[114828]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info" returned: 0 in 0.642s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:25 devstack cinder-volume[93867]: WARNING cinder.volume.drivers.remotefs [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info is being set with open permissions: ugo+rw Jun 24 16:20:25 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:25 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info Jun 24 16:20:25 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:26 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-c351a89e-b192-4d1c-b585-153966f2104d" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-c351a89e-b192-4d1c-b585-153966f2104d" released by "delete_volume" :: held 1.485s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:26 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.info" returned: 0 in 0.653s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.457s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:26 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-1a560b4f-a19e-4489-a056-403c37a5916e tempest-CinderUnicodeTest-1797103226 None] Create snapshot completed successfully Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['66a8b78c-befd-43c7-a680-bd5f9f275e03', '69e0f419-31d8-496d-9439-7e43d5c77685', '18482415-08b9-4498-a575-e8f7d4b0c54f', '70ce7d31-58c7-49c6-9c24-8a612a62146c'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:26 devstack sudo[114840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:26 devstack sudo[114840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-66d12850-d643-46e4-bbb3-068143b802a8-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-66d12850-d643-46e4-bbb3-068143b802a8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-66d12850-d643-46e4-bbb3-068143b802a8" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-66d12850-d643-46e4-bbb3-068143b802a8" acquired by "delete_volume" :: waited 0.024s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06354ce-cdee-409e-a4ad-e01678e30852]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:26 devstack sudo[114840]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.677s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:26 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleted volume successfully. Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-f440df79-142b-42df-9315-7fbbd4d571a6-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:26 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 Jun 24 16:20:26 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-f440df79-142b-42df-9315-7fbbd4d571a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-quobyte-33b3a32e-0605-4979-a178-1eeba1e24274" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:26 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e1fc8047-3960-4100-a6c0-5575c67fb2b1 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-c351a89e-b192-4d1c-b585-153966f2104d-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-33b3a32e-0605-4979-a178-1eeba1e24274" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-quobyte-f440df79-142b-42df-9315-7fbbd4d571a6" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-f440df79-142b-42df-9315-7fbbd4d571a6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Deleting offline snapshot f440df79-142b-42df-9315-7fbbd4d571a6 of volume 33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] snapshot_file for this snap is: volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c14e7d-e639-467d-9d19-efbbcb068bbf]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:27 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 Jun 24 16:20:27 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:27 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8" returned: 0 in 0.779s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:27 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8 Jun 24 16:20:27 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:27 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6" returned: 0 in 0.760s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b3a32e-0605-4979-a178-1eeba1e24274(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[199c5f3e-6c91-4874-be3e-3b53ac67b1b9]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:27 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:27 devstack sudo[114855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 Jun 24 16:20:27 devstack sudo[114855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:28 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-66d12850-d643-46e4-bbb3-068143b802a8" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-66d12850-d643-46e4-bbb3-068143b802a8" released by "delete_volume" :: held 1.472s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['74e4d300-eb98-4d2d-b7bd-eb0924b31b8b', '0aaf3f2b-20bc-4564-8e95-1a064ea8d0c1', 'c58a4f58-31b7-423f-82ed-6fbfb3a61f45', '6e90342b-d992-47d4-9aea-489ec5e3095d'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:28 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:28 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:28 devstack sudo[114855]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274" returned: 0 in 0.744s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:28 devstack sudo[114863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 Jun 24 16:20:28 devstack sudo[114863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-879aa1bf-6213-4a1a-91b9-09a506ec9569-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:28 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-879aa1bf-6213-4a1a-91b9-09a506ec9569-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-879aa1bf-6213-4a1a-91b9-09a506ec9569" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:29 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.663s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-879aa1bf-6213-4a1a-91b9-09a506ec9569" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:29 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleted volume successfully. Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a8c717-f9b8-4827-a0d4-0a29a04af3ab]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-f6938e80-31ee-4a10-bc36-407bea6bfde5 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-66d12850-d643-46e4-bbb3-068143b802a8-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:29 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 Jun 24 16:20:29 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:29 devstack sudo[114863]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6" returned: 0 in 0.752s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:29 devstack sudo[114871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6 Jun 24 16:20:29 devstack sudo[114871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:29 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569" returned: 0 in 0.767s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:29 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569 Jun 24 16:20:29 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:29 devstack sudo[114871]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:29 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274.f440df79-142b-42df-9315-7fbbd4d571a6" returned: 0 in 0.654s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-f440df79-142b-42df-9315-7fbbd4d571a6" released by "_delete_snapshot" :: held 3.023s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-33b3a32e-0605-4979-a178-1eeba1e24274" released by "delete_snapshot" :: held 3.045s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Created reservations ['ca5571fa-168f-43d8-836d-97ff88779609', 'f8db9761-073d-4231-81e1-45996bda2418', '79885e9d-44e2-484a-bc48-2d87b2de171f', '76ff6f44-9726-4e39-9d8f-203efbab93fc'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:30 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Delete snapshot completed successfully. Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-72342894-da1a-4472-8d90-1474c3a22a09 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-f440df79-142b-42df-9315-7fbbd4d571a6-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:30 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-879aa1bf-6213-4a1a-91b9-09a506ec9569" returned: 0 in 0.676s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-879aa1bf-6213-4a1a-91b9-09a506ec9569" released by "delete_volume" :: held 1.488s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['ed757884-d678-492e-a45f-a9acf011cc83', '1aadd5eb-cb39-4330-adae-e57115672ae6', '5b39401a-353c-4e45-9b16-2b5016bd5094', '24a174b1-2419-4333-8c74-81fee5c771b6'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:30 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:30 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:30 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-33b3a32e-0605-4979-a178-1eeba1e24274-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-5857d4b4-afe5-4048-ae8b-740fef961489-delete_snapshot" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-33b3a32e-0605-4979-a178-1eeba1e24274-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-5857d4b4-afe5-4048-ae8b-740fef961489-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-215aa785-6284-4c0e-a094-4531cbf1e71b" by "delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-215aa785-6284-4c0e-a094-4531cbf1e71b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-5857d4b4-afe5-4048-ae8b-740fef961489" by "_delete_snapshot" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-quobyte-33b3a32e-0605-4979-a178-1eeba1e24274" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-5857d4b4-afe5-4048-ae8b-740fef961489" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleting offline snapshot 5857d4b4-afe5-4048-ae8b-740fef961489 of volume 215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 16:20:31 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] snapshot_file for this snap is: volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 {{(pid=93867) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.699s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:31 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleted volume successfully. Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-33b3a32e-0605-4979-a178-1eeba1e24274" acquired by "delete_volume" :: waited 0.055s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f0c557-1c91-4f50-b338-baf929947337]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[435f3912-9a83-4c20-816c-1cf01f8a036a]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:31 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-85eba841-d948-4e3c-b3ab-eac4fe2d5dc6 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-879aa1bf-6213-4a1a-91b9-09a506ec9569-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:31 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 Jun 24 16:20:31 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:31 devstack sudo[114884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 Jun 24 16:20:31 devstack sudo[114884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:32 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489" returned: 0 in 0.796s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.remotefs [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-215aa785-6284-4c0e-a094-4531cbf1e71b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93867) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 16:20:32 devstack sudo[114884]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274" returned: 0 in 0.797s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72eed31-461d-47e3-ba14-e4110a39050d]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:32 devstack sudo[114899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274 Jun 24 16:20:32 devstack sudo[114899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:32 devstack sudo[114900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b Jun 24 16:20:32 devstack sudo[114900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:32 devstack sudo[114899]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-33b3a32e-0605-4979-a178-1eeba1e24274" returned: 0 in 0.668s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-33b3a32e-0605-4979-a178-1eeba1e24274" released by "delete_volume" :: held 1.530s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Created reservations ['326b9ac3-3d4d-420f-84a5-86273c9ffccc', '7f6a5a9a-d7ff-4e05-a3ec-d2bcc69e03db', 'c10fc8e6-00b8-441c-97f1-12982dbd755d', '5971f0cb-f071-4654-8c1d-a18aa03a0c82'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:32 devstack sudo[114900]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b" returned: 0 in 0.765s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:32 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 Jun 24 16:20:32 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:32 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:33 devstack sudo[114909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:33 devstack sudo[114909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-974a193f-9622-4cba-a93a-ae40902a8c7e-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-974a193f-9622-4cba-a93a-ae40902a8c7e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "cinder-quobyte-974a193f-9622-4cba-a93a-ae40902a8c7e" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-974a193f-9622-4cba-a93a-ae40902a8c7e" acquired by "delete_volume" :: waited 0.020s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60bef57-b436-4f00-95fb-2f363753023b]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:33 devstack sudo[114914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e Jun 24 16:20:33 devstack sudo[114914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:33 devstack sudo[114909]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.687s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:33 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Deleted volume successfully. Jun 24 16:20:33 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489" returned: 0 in 0.759s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:33 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-e3ed244f-e26e-4739-9df3-2474c0bc8402 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-33b3a32e-0605-4979-a178-1eeba1e24274-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:33 devstack sudo[114917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489 Jun 24 16:20:33 devstack sudo[114917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:34 devstack sudo[114914]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e" returned: 0 in 0.808s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:34 devstack sudo[114917]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b.5857d4b4-afe5-4048-ae8b-740fef961489" returned: 0 in 0.667s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:34 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e Jun 24 16:20:34 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-5857d4b4-afe5-4048-ae8b-740fef961489" released by "_delete_snapshot" :: held 3.129s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-215aa785-6284-4c0e-a094-4531cbf1e71b" released by "delete_snapshot" :: held 3.164s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['c32c69c8-be5e-44f4-bd97-93a9cc77f0b5', '0d6b8ea5-d8b7-407a-9f59-9264f179b8f3', '5f5baada-be89-4052-8b18-81b88ec36dd6', 'ccaba192-6472-4f5e-9030-715fa1262eda'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:34 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Delete snapshot completed successfully. Jun 24 16:20:34 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-493f3ad1-96ee-4ecd-b580-5855b3843126 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-5857d4b4-afe5-4048-ae8b-740fef961489-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:35 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-974a193f-9622-4cba-a93a-ae40902a8c7e" returned: 0 in 0.648s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-quobyte-974a193f-9622-4cba-a93a-ae40902a8c7e" released by "delete_volume" :: held 1.495s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Created reservations ['b73b5f42-c0dd-4d64-94dd-0edb067fb2ca', 'a2a1f393-3344-4143-9b04-86282a4703b1', 'd2c17f09-e107-4be6-bd30-264ab036f802', '2293da73-0b05-4869-a51a-2811533e08cb'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:35 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:35 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-215aa785-6284-4c0e-a094-4531cbf1e71b-delete_volume" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-215aa785-6284-4c0e-a094-4531cbf1e71b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "cinder-quobyte-215aa785-6284-4c0e-a094-4531cbf1e71b" by "delete_volume" {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-215aa785-6284-4c0e-a094-4531cbf1e71b" acquired by "delete_volume" :: waited 0.014s {{(pid=93867) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd0e9ec-73c2-41e7-bb6e-a784e3687422]: (4, 'qcow2') {{(pid=95542) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:35 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b Jun 24 16:20:35 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:35 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.653s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:35 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Deleted volume successfully. Jun 24 16:20:35 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-33492f17-b54c-4a73-85b9-a248290379f5 tempest-CinderUnicodeTest-1797103226 None] Lock "cinder-974a193f-9622-4cba-a93a-ae40902a8c7e-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:36 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b" returned: 0 in 0.799s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:36 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:36 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b Jun 24 16:20:36 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:37 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d/volume-215aa785-6284-4c0e-a094-4531cbf1e71b" returned: 0 in 0.664s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-quobyte-215aa785-6284-4c0e-a094-4531cbf1e71b" released by "delete_volume" :: held 1.526s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG cinder.quota [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Created reservations ['9b68a5a5-4cc2-4d22-9809-943df1264465', 'af29a6cd-23b9-404b-b0b4-9e8e1ab114bd', '2c25289b-4704-4689-8b25-a31158c2d2a8', '9ced8293-e8d6-4cca-8d72-6fcf708456be'] {{(pid=93867) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:37 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:37 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:37 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.645s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:37 devstack cinder-volume[93867]: INFO cinder.volume.manager [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Deleted volume successfully. Jun 24 16:20:37 devstack cinder-volume[93867]: DEBUG cinder.coordination [None req-ccdb0f99-1094-496d-b61d-42f655d43206 tempest-CreateVolumesFromSnapshotTest-614105882 None] Lock "cinder-215aa785-6284-4c0e-a094-4531cbf1e71b-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=93867) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56': None} {{(pid=93867) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG cinder.volume.drivers.quobyte [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0c4970e-2a10-4165-ac64-e44c13f46b56'] {{(pid=93867) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.lockutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93867) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 16:20:39 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d Jun 24 16:20:39 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 16:20:39 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_concurrency.processutils [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/39688c5712a61062580678f3718c5a2d" returned: 0 in 0.655s {{(pid=93867) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG cinder.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Notifying Schedulers of capabilities ... {{(pid=93867) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG oslo_service.periodic_task [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] Running periodic task VolumeManager._thread_info {{(pid=93867) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread count: 28 {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 16:20:39 devstack cinder-volume[93867]: DEBUG cinder.volume.manager [None req-e0b2adda-517b-4a61-a94a-20f01bdf6e73 None None] thread info: [<_MainThread(MainThread, started 135110170353792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93867) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 16:20:47 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=91,cinder:INSERT=33,cinder:UPDATE=129,cinder:DELETE=10 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 16:20:47 devstack cinder-volume[93867]: DEBUG dbcounter [-] [93867] Writing DB stats cinder:SELECT=93,cinder:UPDATE=129,cinder:DELETE=11,cinder:INSERT=32 {{(pid=93867) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}